-- Logs begin at Thu 2022-07-14 08:34:18 UTC, end at Thu 2022-07-14 09:35:29 UTC. -- Jul 14 09:03:56.456379 dv-cinder-849626-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 09:03:56.467834 dv-cinder-849626-4-smb devstack@keystone.service[80195]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 09:03:56.469909 dv-cinder-849626-4-smb devstack@keystone.service[80195]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 09:03:56 2022] *** Jul 14 09:03:56.469909 dv-cinder-849626-4-smb devstack@keystone.service[80195]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 09:03:56.469909 dv-cinder-849626-4-smb devstack@keystone.service[80195]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 09:03:56.469909 dv-cinder-849626-4-smb devstack@keystone.service[80195]: nodename: dv-cinder-849626-4-smb Jul 14 09:03:56.469909 dv-cinder-849626-4-smb devstack@keystone.service[80195]: machine: x86_64 Jul 14 09:03:56.469909 dv-cinder-849626-4-smb devstack@keystone.service[80195]: clock source: unix Jul 14 09:03:56.469909 dv-cinder-849626-4-smb devstack@keystone.service[80195]: pcre jit disabled Jul 14 09:03:56.469909 dv-cinder-849626-4-smb devstack@keystone.service[80195]: detected number of CPU cores: 4 Jul 14 09:03:56.469909 dv-cinder-849626-4-smb devstack@keystone.service[80195]: current working directory: / Jul 14 09:03:56.469909 dv-cinder-849626-4-smb devstack@keystone.service[80195]: detected binary path: /usr/bin/uwsgi-core Jul 14 09:03:56.470511 dv-cinder-849626-4-smb devstack@keystone.service[80195]: your processes number limit is 47680 Jul 14 09:03:56.470511 dv-cinder-849626-4-smb devstack@keystone.service[80195]: your memory page size is 4096 bytes Jul 14 09:03:56.470511 dv-cinder-849626-4-smb devstack@keystone.service[80195]: detected max file descriptor number: 2048 Jul 14 09:03:56.470511 dv-cinder-849626-4-smb devstack@keystone.service[80195]: lock engine: pthread robust mutexes Jul 14 09:03:56.470511 dv-cinder-849626-4-smb devstack@keystone.service[80195]: thunder lock: enabled Jul 14 09:03:56.470511 dv-cinder-849626-4-smb devstack@keystone.service[80195]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 09:03:56.470511 dv-cinder-849626-4-smb devstack@keystone.service[80195]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 09:03:56.514786 dv-cinder-849626-4-smb devstack@keystone.service[80195]: Python main interpreter initialized at 0x560a3671a9c0 Jul 14 09:03:56.514786 dv-cinder-849626-4-smb devstack@keystone.service[80195]: python threads support enabled Jul 14 09:03:56.514786 dv-cinder-849626-4-smb devstack@keystone.service[80195]: your server socket listen backlog is limited to 100 connections Jul 14 09:03:56.514786 dv-cinder-849626-4-smb devstack@keystone.service[80195]: your mercy for graceful operations on workers is 90 seconds Jul 14 09:03:56.515124 dv-cinder-849626-4-smb devstack@keystone.service[80195]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 09:03:56.515197 dv-cinder-849626-4-smb devstack@keystone.service[80195]: *** Operational MODE: preforking *** Jul 14 09:03:56.515456 dv-cinder-849626-4-smb devstack@keystone.service[80195]: *** uWSGI is running in multiple interpreter mode *** Jul 14 09:03:56.515456 dv-cinder-849626-4-smb devstack@keystone.service[80195]: spawned uWSGI master process (pid: 80195) Jul 14 09:03:56.515661 dv-cinder-849626-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 14 09:03:56.520583 dv-cinder-849626-4-smb devstack@keystone.service[80195]: spawned uWSGI worker 1 (pid: 80205, cores: 1) Jul 14 09:03:56.520583 dv-cinder-849626-4-smb devstack@keystone.service[80195]: spawned uWSGI worker 2 (pid: 80206, cores: 1) Jul 14 09:03:56.520583 dv-cinder-849626-4-smb devstack@keystone.service[80195]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 09:04:01.859280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:04:01.859280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: from cryptography.utils import int_from_bytes Jul 14 09:04:01.860096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:04:01.860096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: from cryptography.utils import int_from_bytes Jul 14 09:04:01.860219 dv-cinder-849626-4-smb devstack@keystone.service[80205]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:04:01.860219 dv-cinder-849626-4-smb devstack@keystone.service[80205]: from cryptography.utils import int_from_bytes Jul 14 09:04:01.860608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:04:01.860608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: from cryptography.utils import int_from_bytes Jul 14 09:04:01.907419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 09:04:01.907619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 09:04:01.907787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] command line args: [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 09:04:01.908021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 09:04:01.908186 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 09:04:01.908322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ================================================================================ {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 09:04:01.908413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 09:04:01.908485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] admin_token = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.908544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] command line args: [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 09:04:01.908691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] config_dir = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.908819 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 09:04:01.908898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.908990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ================================================================================ {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 09:04:01.909072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] config_source = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.909215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] debug = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.909350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] admin_token = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.909434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.909685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] config_dir = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.909685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.909805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.909862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] config_source = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.909924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.909992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] debug = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.910136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.910217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.910375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.910463 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.910532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.910591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.910778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_config_append = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.910902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.910976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.911042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.911113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_dir = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.911245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.911329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_file = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.911389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_config_append = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.911452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.911569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.911686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.911808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_dir = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.911930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_file = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.912011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.912109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.912201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.912342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.912474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.912612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.912717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.912806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.912880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.913014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.913100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.913167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.913282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.913400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.913495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.913615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.913695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.913817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.913899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.914085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.914231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.914314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.914449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.914532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.914605 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.914731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.914996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.915118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.915199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] publish_errors = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.915273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.915423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.915636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.915767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.915857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.915946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] publish_errors = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.916021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.916087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.916247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.916370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.916472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] standard_threads = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.916559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.916751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.916889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.916965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917050 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] standard_threads = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] use_journal = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] use_json = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] use_stderr = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] use_syslog = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.917972 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] use_journal = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.918127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] use_json = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.918289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.918414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] use_stderr = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.918612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.918695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] use_syslog = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.918695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:04:01.918845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.918925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.919072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.919205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.919290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.919504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.919591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.919669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.919741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.919885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.920008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.920085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.920169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.920347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.920469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.920545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.920615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.920835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.920975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.921059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.921128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.921301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.921421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.921509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.921596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.921759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.921882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.921969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.922042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.922224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.922431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.922431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.922579 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.922650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.922719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.922920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.923057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.923141 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.923223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.923401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.923533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.923613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.923698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.923871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.924002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.924089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.924168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.924319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.924454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.924541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.924613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.924737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.924813 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.925017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.925152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.925231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.925302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.925454 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.925535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.925679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.925759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.925916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.925996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.926143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.926222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.926373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.926453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.926612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.926690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.926837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.926917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.927065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.927145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.927294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.927373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.927516 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.927601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.927745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.927818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.927952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.928031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.928176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.928255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.928399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.928478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.928626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.928758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.928877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.928955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.929108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.929188 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.929317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.929394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.929546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.929621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.929775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.929851 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.929999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.930074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.930224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.930298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.930454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.930530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.930683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.930758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.930912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.931329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.931451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.931521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.931681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.931746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.931904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.931968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.932133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.932200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.932360 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.932426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.932584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.932696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.932843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.932932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.933074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.933157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.933309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.933386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.933532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.933617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.933823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.933942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.934110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.934187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.934339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.934560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.934645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.934801 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.934876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.935065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.935141 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.935299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.935385 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.935530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.935605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.935763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.935839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.935994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.936072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.936224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.936344 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.936458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.936584 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.936830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.936920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.937070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.937147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.937303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.937380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.937537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.937615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.937768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.937845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.937999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.938076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.938231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.938304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.938463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.938538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.938696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.938774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.938933 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.939010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.939165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.939241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.939403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.939487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.939636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.939708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.939858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.939933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.940088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.940164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.940314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.940400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.940540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.940623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.940787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.940865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.941016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.941354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.941354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.941496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.941567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.941636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.941705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.941773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.941910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.941999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.942138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.942214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.942381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.942456 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.942615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.942692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.942863 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.942938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.943091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.external = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.943167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.943318 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.943395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.943566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.external = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.943641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.943802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.943908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.944034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.password = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.944111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.944258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.token = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.944336 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.944492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.944570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.password = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.944742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.944837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.token = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.944984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.945062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.945211 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.945288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.945451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.945535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.945678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.945754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.945904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.945979 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.946134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.946224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.946369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.946446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.946602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.946678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.946842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.946926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.947073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.947150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.947309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.947386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.947538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.947623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.947776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.947852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.948010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.948086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.948245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.948329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.948491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.948569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.948753 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.948831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.949005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.949097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.949265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.949342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.949555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.949634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.949815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.949900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.950055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.950180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.950306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.950421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.950540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.950664 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.950774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.950907 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.951018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.951132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.951263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.951373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.951491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.951604 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.951733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.951851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.951966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.952081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.952216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.952329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.952448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.952561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.952717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.952833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.952953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.953064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.953200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.953304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.953435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.953582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.953691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.953768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.953936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.954013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.954171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.954251 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.954406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.954483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.954643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.954719 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.954871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.954949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.955109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.955194 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.955332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.955409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.955558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.955637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.955782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.955866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.956021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.956099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.956247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.956324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.956487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.956563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.956751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.956830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.956996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.957076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.957247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.957325 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.957489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.957567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.957744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.957821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.957969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.958053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.958200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.958275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.958420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.958497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.958650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.958727 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.958874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.958950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.959106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.959183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.959341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.959423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.959563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.959639 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.959803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.959881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.960028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.960103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.960278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.960406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.960517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.960608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.960768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.960849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.960993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.961070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.961224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.961305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.961448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.961525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.961678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.961755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.961903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.961980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.962135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.962210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.962364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.962441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.962593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.962672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.962824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.962900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.963056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.963132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.963278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.963356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.963502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.963579 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.963742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.963819 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.963967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.964044 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.964196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.964272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.964422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.964499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.964651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.964774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.964902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.964978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.965235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.965344 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.965469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.965708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.965784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.965940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.966017 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.966179 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.966257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.966420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.966496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.966661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.966737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.966892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.966970 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.967116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.967193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.967341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.967417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.967570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.967647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.967797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.967873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.968019 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.968095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.968243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.968320 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.968486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.968561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.968747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.968828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.968990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.969069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.969231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.969307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.969457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.969534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.969686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.969770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.969918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.969994 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.970149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.970226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.970380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.970457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.970608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.970683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.970837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.970913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.971079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.971156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.971312 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.971389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.971543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.971619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.971773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.971850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.972009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.972085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.972237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.972314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.972468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.972547 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.972718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.972800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.972954 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.973031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.973190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.973269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.973418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.973494 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.973649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.973726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.973882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.973959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.974118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.974195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.974358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.974434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.974589 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.974667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.974821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.974896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.975062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.975138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.975292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.975371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.975527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.975603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.975756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.975831 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.975976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.976050 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.976204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] role.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.976281 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.976433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] role.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.976509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] role.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.976693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.976791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] role.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.976924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.976997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.977169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.977245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.977412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.977490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.977654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.977731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.977896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.977981 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.978136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.978213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.978378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.978455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.978620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.978704 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.978847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.978922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.979086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.979161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.979326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.979410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.979568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.979645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.979808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.979885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.980056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.980214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.980451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.980526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.980794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.980887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.980992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.981137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.981225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.981297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.981471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.981549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.981719 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.981806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.981953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.982030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.982204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.982281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.982453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.982537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.982684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.982761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.982913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.982989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.983137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.983221 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.983364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.983440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.983612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.983688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.983853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.983931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.984085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.984162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.984315 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.984391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.984542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.984620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.984796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.984875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.985028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.985105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.985268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.985354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.985488 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.985564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.985723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.985799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.985969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.986047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.986203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.986279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.986437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.986513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.986671 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.986748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.986910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.986986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.987138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.987214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.987370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.987448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.987597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.987674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.987825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.987900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.988066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.988143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.988287 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.988364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.988519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.988595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.988779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.988860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.989070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.989147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.connection = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.989311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.989397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.connection = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.989554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.989640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.989786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.989871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.990021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.990097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.990293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.990379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.990524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.990609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.990753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.990831 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.990984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.991060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.991218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.991305 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.991449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.991526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.991688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.991765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.991918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.992004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.992149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.992225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.992379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.992455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.992613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.992755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.992868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.992944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.993094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.993170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.993322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.993406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.993479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 09:04:01.993550 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:04:01.993712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 09:04:02.023856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.024050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.024285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.024409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.024618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.024870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.032682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.033304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.061004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.061250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.061519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.061758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.203666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.204181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.251772 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.251963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.252612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.252869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.315820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.316015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.316082 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.316247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.316398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.316471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.316546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.316640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.316751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.316975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.317116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.317190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.342810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.343011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.343084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.343172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.343250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.343312 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.343494 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.343618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.343769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.343901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.344023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.344103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.344221 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.344301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.355202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.355328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.368178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.368346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.368557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.368732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.368820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.369005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.369121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.369292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.369479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.369569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.369569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.369776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.369904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.369993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:04:02.387658 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.387840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 09:04:02.387974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.388202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 09:04:02.388432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.388598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 09:04:02.388778 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.388899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.389029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 09:04:02.389214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.389328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.389484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.389608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.389688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.389751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.389995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.400310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.400583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.400725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.400870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.401010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.401147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.401277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.401492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.409242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.409855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.412435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.412706 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.413010 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.413132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.413287 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.413428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.413553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.413673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.413754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.413874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.414037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.414127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.414245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.414403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.414531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.414642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.414745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.414907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.414988 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.415171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.415437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.415699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.441398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.442246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.442989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.443258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.443843 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.444120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.448399 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.448686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.448966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.449383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.449673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.450016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.456439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.456682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.457334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.457609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.461073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.461353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.461626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.461902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.462047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.462123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.462274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.462401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.462534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.462624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.462849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.462976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.463094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.463395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.463664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.463928 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.481237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.481509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.482694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.482969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.486051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.487528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.489647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.489932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.491128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.491420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.494968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.496597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.498580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.500254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.502148 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.502441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.502739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.503023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.503296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.503559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.503860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.504150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.504426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.504705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.505008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.505265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.522242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.522520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.522780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.523008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.524107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.524390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.524646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.524927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.530802 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.532472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.532766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.532938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.534481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.534755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.535870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.536144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.536419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.536677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.536980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.537929 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.538210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.538485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.538762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.539087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.549891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.550162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.550429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.550721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.550994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.551376 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.551540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.552193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.552467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.552748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.553047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.553325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.553611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.553890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.570662 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.573166 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.573908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.576455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.577310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.578869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.579732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.580606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.580896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.581181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.581306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.583066 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.583346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.583633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.588308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.589965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.590941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.592548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.593245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.593526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.593803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.594073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.595737 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.596022 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.596301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.596573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.603131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.603409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.603693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.605796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.606052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.606367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.611435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.611710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.611977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.612245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.612507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.612819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.613086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.613354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.613718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.613981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.614104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:04:02.614258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.614386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.614576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.614699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.614820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.614957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.615138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.615268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.615392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.615688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.615943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.616313 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.616581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.616876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.617147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.617408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.617668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:04:02.651938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560a3671a9c0 pid: 80206 (default app) Jul 14 09:04:02.655083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560a3671a9c0 pid: 80205 (default app) Jul 14 09:04:02.655396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6d86-4198-45a3-aad0-a9f28bb52ea2 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:02.655686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6d86-4198-45a3-aad0-a9f28bb52ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:02.655960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6d86-4198-45a3-aad0-a9f28bb52ea2 None None] PATH_INFO: `/v3` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:02.660189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Thu Jul 14 09:04:02 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:10.307890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ba1ed-315f-4181-8c2d-a36c0b37508d None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:10.308846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ba1ed-315f-4181-8c2d-a36c0b37508d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:10.308846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ba1ed-315f-4181-8c2d-a36c0b37508d None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:10.313756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:10.320175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:10.320921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:10.321075 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:10.389380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: INFO dbcounter [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] Registered counter for database keystone Jul 14 09:04:10.414577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG oslo_db.sqlalchemy.engines [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:04:10.422282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writer thread running {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:04:10.608834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG passlib.handlers.bcrypt [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80206) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 09:04:10.609172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG passlib.handlers.bcrypt [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80206) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 09:04:10.664156 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:10.665811 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:10.795858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 09:04:10.866779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ba1ed-315f-4181-8c2d-a36c0b37508d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:10.938902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: INFO dbcounter [None req-515ba1ed-315f-4181-8c2d-a36c0b37508d None None] Registered counter for database keystone Jul 14 09:04:10.960679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG oslo_db.sqlalchemy.engines [None req-515ba1ed-315f-4181-8c2d-a36c0b37508d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:04:10.969442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writer thread running {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:04:11.097010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ba1ed-315f-4181-8c2d-a36c0b37508d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:11.102621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5c7e2-67fa-48b4-be75-ec0b458461fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:11.103282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5c7e2-67fa-48b4-be75-ec0b458461fa admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:11.103614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5c7e2-67fa-48b4-be75-ec0b458461fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:11.104404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5c7e2-67fa-48b4-be75-ec0b458461fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:11.113547 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5c7e2-67fa-48b4-be75-ec0b458461fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:11.167460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9dd5c7e2-67fa-48b4-be75-ec0b458461fa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 09:04:11.167728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5c7e2-67fa-48b4-be75-ec0b458461fa admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:11.178156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Jul 14 09:04:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:04:11.188281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:11.208393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77854b-185f-4cf2-90b2-86a90c9067b0 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:11.214225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17dc96-1dcc-4d7a-9a96-025161449151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:11.215370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17dc96-1dcc-4d7a-9a96-025161449151 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:11.215662 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17dc96-1dcc-4d7a-9a96-025161449151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:11.215944 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17dc96-1dcc-4d7a-9a96-025161449151 admin admin] PATH_INFO: `/v3/projects/0f90549ec6704d3aa11b6699bd90eefe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:11.220151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17dc96-1dcc-4d7a-9a96-025161449151 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f90549ec6704d3aa11b6699bd90eefe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:11.271668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2c17dc96-1dcc-4d7a-9a96-025161449151 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 09:04:11.272007 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17dc96-1dcc-4d7a-9a96-025161449151 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:11.276688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Thu Jul 14 09:04:11 2022] GET /identity/v3/projects/0f90549ec6704d3aa11b6699bd90eefe => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:13.269093 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f15c82-d1e2-408b-b24b-3db68626935d None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:13.269919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f15c82-d1e2-408b-b24b-3db68626935d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:13.269919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f15c82-d1e2-408b-b24b-3db68626935d None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:13.277214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:13.282739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac7337-5a02-4900-91a3-43fdd4203c95 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:13.283190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac7337-5a02-4900-91a3-43fdd4203c95 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:13.283283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac7337-5a02-4900-91a3-43fdd4203c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:13.304412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a7ac7337-5a02-4900-91a3-43fdd4203c95 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:13.305948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a7ac7337-5a02-4900-91a3-43fdd4203c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:13.315251 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 09:04:13.337728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f15c82-d1e2-408b-b24b-3db68626935d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:13.351530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f15c82-d1e2-408b-b24b-3db68626935d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:13.356690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50dad0-0ccb-48df-b04d-b72a63c09bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:13.357356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50dad0-0ccb-48df-b04d-b72a63c09bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:13.357640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50dad0-0ccb-48df-b04d-b72a63c09bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:13.357912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50dad0-0ccb-48df-b04d-b72a63c09bcd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:13.366077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50dad0-0ccb-48df-b04d-b72a63c09bcd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:13.367848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50dad0-0ccb-48df-b04d-b72a63c09bcd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:13.379834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Jul 14 09:04:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:04:13.386401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac7337-5a02-4900-91a3-43fdd4203c95 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:13.401870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac7337-5a02-4900-91a3-43fdd4203c95 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:13.410371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5507df-de90-4464-9349-c212363fe9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:13.411646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5507df-de90-4464-9349-c212363fe9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:13.412066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5507df-de90-4464-9349-c212363fe9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:13.412429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5507df-de90-4464-9349-c212363fe9fe admin admin] PATH_INFO: `/v3/users/ed59d5d85ac94b5e83056380d59a4958` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:13.414626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5507df-de90-4464-9349-c212363fe9fe admin admin] RBAC: Authorizing `identity:get_user(user_id=ed59d5d85ac94b5e83056380d59a4958)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:13.416984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5507df-de90-4464-9349-c212363fe9fe admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:13.418647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Thu Jul 14 09:04:13 2022] GET /identity/v3/users/ed59d5d85ac94b5e83056380d59a4958 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:15.461285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32fc5-0694-41a2-9db8-49c8bc45e2a4 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:15.461872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32fc5-0694-41a2-9db8-49c8bc45e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:15.461872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32fc5-0694-41a2-9db8-49c8bc45e2a4 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:15.463401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:15.468638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279016-2b08-47d1-be9c-503bb406c7b5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:15.469082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279016-2b08-47d1-be9c-503bb406c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:15.469221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279016-2b08-47d1-be9c-503bb406c7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:15.486764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-11279016-2b08-47d1-be9c-503bb406c7b5 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:15.487959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-11279016-2b08-47d1-be9c-503bb406c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:15.519262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3aa40e-75be-4725-9993-a081e70cccf5 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:15.519555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3aa40e-75be-4725-9993-a081e70cccf5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:15.519874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3aa40e-75be-4725-9993-a081e70cccf5 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:15.521435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:15.527835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b2bd-2f95-40a6-8d06-936bab3b2e8f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:15.528151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b2bd-2f95-40a6-8d06-936bab3b2e8f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:15.528433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b2bd-2f95-40a6-8d06-936bab3b2e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:15.578713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG passlib.handlers.bcrypt [None req-0d09b2bd-2f95-40a6-8d06-936bab3b2e8f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80205) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 09:04:15.579110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG passlib.handlers.bcrypt [None req-0d09b2bd-2f95-40a6-8d06-936bab3b2e8f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80205) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 09:04:15.588239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:15.611129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279016-2b08-47d1-be9c-503bb406c7b5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:15.624354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0d09b2bd-2f95-40a6-8d06-936bab3b2e8f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:15.625995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0d09b2bd-2f95-40a6-8d06-936bab3b2e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:15.635827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:15.719561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279016-2b08-47d1-be9c-503bb406c7b5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:15.726397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:15.748200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b2bd-2f95-40a6-8d06-936bab3b2e8f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:15.752278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d2ca8-2209-4db9-9d91-729bd8240c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:15.753112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2ca8-2209-4db9-9d91-729bd8240c66 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:15.753396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2ca8-2209-4db9-9d91-729bd8240c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:15.753672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2ca8-2209-4db9-9d91-729bd8240c66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:15.765088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d2ca8-2209-4db9-9d91-729bd8240c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-626d2ca8-2209-4db9-9d91-729bd8240c66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:15.776299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:15.777263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:15.778296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:15.783692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d2ca8-2209-4db9-9d91-729bd8240c66 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:15.850473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b2bd-2f95-40a6-8d06-936bab3b2e8f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:15.853288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:15.866110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:15.889858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9db56-c10d-4e73-98d1-c30d7fb4ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:15.890648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d2ca8-2209-4db9-9d91-729bd8240c66 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:15.890774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9db56-c10d-4e73-98d1-c30d7fb4ea3b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:15.890971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9db56-c10d-4e73-98d1-c30d7fb4ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:15.891252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9db56-c10d-4e73-98d1-c30d7fb4ea3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:15.925574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553a9fd-878e-404a-8ddd-36391bebfb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:15.926250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553a9fd-878e-404a-8ddd-36391bebfb9a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:15.926532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553a9fd-878e-404a-8ddd-36391bebfb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:15.926808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553a9fd-878e-404a-8ddd-36391bebfb9a None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:15.927568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553a9fd-878e-404a-8ddd-36391bebfb9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:15.927875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553a9fd-878e-404a-8ddd-36391bebfb9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:15.929614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553a9fd-878e-404a-8ddd-36391bebfb9a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:15.941682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:15.947373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553a9fd-878e-404a-8ddd-36391bebfb9a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:15.960569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9db56-c10d-4e73-98d1-c30d7fb4ea3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:15.962265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9db56-c10d-4e73-98d1-c30d7fb4ea3b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:16.046394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553a9fd-878e-404a-8ddd-36391bebfb9a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:16.061789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:16.067381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9db56-c10d-4e73-98d1-c30d7fb4ea3b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:16.070058 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:16.081780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214347e-4a21-4a10-9275-73238b9f713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:16.082718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214347e-4a21-4a10-9275-73238b9f713b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:16.083008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214347e-4a21-4a10-9275-73238b9f713b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:16.083289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214347e-4a21-4a10-9275-73238b9f713b None admin] PATH_INFO: `/v3/users/ed59d5d85ac94b5e83056380d59a4958` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:16.084573 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214347e-4a21-4a10-9275-73238b9f713b None admin] RBAC: Authorizing `identity:get_user(user_id=ed59d5d85ac94b5e83056380d59a4958)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:16.086070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214347e-4a21-4a10-9275-73238b9f713b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:16.087848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:15 2022] GET /identity/v3/users/ed59d5d85ac94b5e83056380d59a4958 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:16.093184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214347e-4a21-4a10-9275-73238b9f713b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:16.107778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:16.166013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9db56-c10d-4e73-98d1-c30d7fb4ea3b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:16.194366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214347e-4a21-4a10-9275-73238b9f713b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:16.199824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841d1a-16bc-40c8-9934-6eecfef88397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:16.200621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841d1a-16bc-40c8-9934-6eecfef88397 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:16.200933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841d1a-16bc-40c8-9934-6eecfef88397 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:16.201207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841d1a-16bc-40c8-9934-6eecfef88397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:16.220193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6841d1a-16bc-40c8-9934-6eecfef88397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:16.221774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6841d1a-16bc-40c8-9934-6eecfef88397 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:16.229951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bd916-3dc5-4a8a-b5d9-aaffdc58089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:16.230759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bd916-3dc5-4a8a-b5d9-aaffdc58089f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:16.231044 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bd916-3dc5-4a8a-b5d9-aaffdc58089f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:16.231322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bd916-3dc5-4a8a-b5d9-aaffdc58089f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:16.232511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bd916-3dc5-4a8a-b5d9-aaffdc58089f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:16.233976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bd916-3dc5-4a8a-b5d9-aaffdc58089f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:16.235579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:16.241282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bd916-3dc5-4a8a-b5d9-aaffdc58089f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-b6841d1a-16bc-40c8-9934-6eecfef88397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:04:16.244889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:16.245692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:16.246482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:04:16.246482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:04:16.246482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:04:16.246482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:16.246482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:04:16.252767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841d1a-16bc-40c8-9934-6eecfef88397 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:16.310938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:16.321431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:16.342740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bd916-3dc5-4a8a-b5d9-aaffdc58089f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:16.356646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841d1a-16bc-40c8-9934-6eecfef88397 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:16.377900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84801b8e-83fc-4a33-9e68-5d0aa05d9837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:16.378566 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801b8e-83fc-4a33-9e68-5d0aa05d9837 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:16.378850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801b8e-83fc-4a33-9e68-5d0aa05d9837 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:16.379130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801b8e-83fc-4a33-9e68-5d0aa05d9837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:16.379982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84801b8e-83fc-4a33-9e68-5d0aa05d9837 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.domain.id=default, user.id=ed59d5d85ac94b5e83056380d59a4958) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:16.380292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84801b8e-83fc-4a33-9e68-5d0aa05d9837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:16.381812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84801b8e-83fc-4a33-9e68-5d0aa05d9837 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:16.388956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Thu Jul 14 09:04:16 2022] GET /identity/v3/role_assignments?user.id=ed59d5d85ac94b5e83056380d59a4958&scope.domain.id=default&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:16.393031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a26cec-253f-46a0-be50-c4b0994b743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:16.393764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26cec-253f-46a0-be50-c4b0994b743d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:16.394081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26cec-253f-46a0-be50-c4b0994b743d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:16.394377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26cec-253f-46a0-be50-c4b0994b743d None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:16.395158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a26cec-253f-46a0-be50-c4b0994b743d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:16.395489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a26cec-253f-46a0-be50-c4b0994b743d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:16.396968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a26cec-253f-46a0-be50-c4b0994b743d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:16.419324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:18.830773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65747849-a968-4606-9b09-aad020eaf055 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:18.831633 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65747849-a968-4606-9b09-aad020eaf055 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:18.832055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65747849-a968-4606-9b09-aad020eaf055 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:18.833631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:18.839603 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234fedd-40d1-47fb-87d9-1135eca04fed None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:18.840034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234fedd-40d1-47fb-87d9-1135eca04fed None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:18.840212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234fedd-40d1-47fb-87d9-1135eca04fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:18.865667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a234fedd-40d1-47fb-87d9-1135eca04fed None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:18.866871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a234fedd-40d1-47fb-87d9-1135eca04fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:18.950402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:18.984792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65747849-a968-4606-9b09-aad020eaf055 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:19.037372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c073c-95fc-42a6-92d4-7bc522de61ae None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.037685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c073c-95fc-42a6-92d4-7bc522de61ae None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.037931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c073c-95fc-42a6-92d4-7bc522de61ae None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.039442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:04:19.044464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ae09-d34d-4607-b6ff-7a12d196c50a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.044777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ae09-d34d-4607-b6ff-7a12d196c50a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.045057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ae09-d34d-4607-b6ff-7a12d196c50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.078348 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-03f2ae09-d34d-4607-b6ff-7a12d196c50a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:19.079552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-03f2ae09-d34d-4607-b6ff-7a12d196c50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:19.154845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65747849-a968-4606-9b09-aad020eaf055 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:19.159738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:19.191358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56895d0d-1f59-4ad5-90a3-0262d3882084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:19.191584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:19.196687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56895d0d-1f59-4ad5-90a3-0262d3882084 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.196816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701e2e6-c95e-447b-a68b-3aa107abca33 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.196816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701e2e6-c95e-447b-a68b-3aa107abca33 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.196816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701e2e6-c95e-447b-a68b-3aa107abca33 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.196816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 14/26] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:19.196816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a48eea-e516-4cb2-a932-45c70e14dd71 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.196816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a48eea-e516-4cb2-a932-45c70e14dd71 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.197175 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a48eea-e516-4cb2-a932-45c70e14dd71 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.197634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 15/27] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:19.197940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56895d0d-1f59-4ad5-90a3-0262d3882084 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.198236 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56895d0d-1f59-4ad5-90a3-0262d3882084 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.200499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42ead5-d93f-49e5-9457-101a33f48d9b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.201003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42ead5-d93f-49e5-9457-101a33f48d9b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.201484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42ead5-d93f-49e5-9457-101a33f48d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.220197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7a42ead5-d93f-49e5-9457-101a33f48d9b None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:19.221977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7a42ead5-d93f-49e5-9457-101a33f48d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:19.231948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56895d0d-1f59-4ad5-90a3-0262d3882084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-56895d0d-1f59-4ad5-90a3-0262d3882084 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:19.240129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:19.241029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:19.241776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:19.244284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 13/28] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:04:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:19.245752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b93720-1a83-47ff-8c26-908402f0d6c7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.246243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b93720-1a83-47ff-8c26-908402f0d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.246721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b93720-1a83-47ff-8c26-908402f0d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.253489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:19.267364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-99b93720-1a83-47ff-8c26-908402f0d6c7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:19.269014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-99b93720-1a83-47ff-8c26-908402f0d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:19.305097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 16/29] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:19.306070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42ead5-d93f-49e5-9457-101a33f48d9b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:19.345576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 14/30] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:19.346801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b93720-1a83-47ff-8c26-908402f0d6c7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:19.432452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42ead5-d93f-49e5-9457-101a33f48d9b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:19.441415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:19.465093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b93720-1a83-47ff-8c26-908402f0d6c7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:19.475814 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be7c52-d708-4362-9145-dbf29d0b6b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:19.476870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7c52-d708-4362-9145-dbf29d0b6b78 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.477159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7c52-d708-4362-9145-dbf29d0b6b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.477764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7c52-d708-4362-9145-dbf29d0b6b78 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.478621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be7c52-d708-4362-9145-dbf29d0b6b78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:19.480180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be7c52-d708-4362-9145-dbf29d0b6b78 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:19.503955 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1c307-0709-4bac-a9e7-8befc902e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:19.505135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1c307-0709-4bac-a9e7-8befc902e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.505622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1c307-0709-4bac-a9e7-8befc902e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.506144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1c307-0709-4bac-a9e7-8befc902e4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.507264 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1c307-0709-4bac-a9e7-8befc902e4b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:19.507845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1c307-0709-4bac-a9e7-8befc902e4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:19.509586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1c307-0709-4bac-a9e7-8befc902e4b3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:19.511613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:19.521783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 15/31] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:19.522824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1c307-0709-4bac-a9e7-8befc902e4b3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:19.616389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 17/32] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jul 14 09:04:19 2022] POST /identity/v3/roles => generated 219 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:04:19.617896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be7c52-d708-4362-9145-dbf29d0b6b78 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:19.632487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1c307-0709-4bac-a9e7-8befc902e4b3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:19.671834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2cc91-0571-4820-8790-865177187522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:19.672750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2cc91-0571-4820-8790-865177187522 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.673068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2cc91-0571-4820-8790-865177187522 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.673433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2cc91-0571-4820-8790-865177187522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.686710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2cc91-0571-4820-8790-865177187522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:19.688284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2cc91-0571-4820-8790-865177187522 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-93d2cc91-0571-4820-8790-865177187522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:04:19.710487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:19.711864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:19.713169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:04:19.713169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:04:19.713169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:04:19.713169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:19.713169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 16/33] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:19.713169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2cc91-0571-4820-8790-865177187522 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:19.770624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:19.829940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2cc91-0571-4820-8790-865177187522 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:19.838445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be7c52-d708-4362-9145-dbf29d0b6b78 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:19.867636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3436a4d-504d-44bc-9e63-9f36d384706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:19.868632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3436a4d-504d-44bc-9e63-9f36d384706d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.869033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3436a4d-504d-44bc-9e63-9f36d384706d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.869319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3436a4d-504d-44bc-9e63-9f36d384706d None admin] PATH_INFO: `/v3/users/ed59d5d85ac94b5e83056380d59a4958` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.870612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3436a4d-504d-44bc-9e63-9f36d384706d None admin] RBAC: Authorizing `identity:get_user(user_id=ed59d5d85ac94b5e83056380d59a4958)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:19.872283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3436a4d-504d-44bc-9e63-9f36d384706d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:19.874321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 17/34] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:19 2022] GET /identity/v3/users/ed59d5d85ac94b5e83056380d59a4958 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:19.874926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3436a4d-504d-44bc-9e63-9f36d384706d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:19.877537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531085bc-be08-4494-862b-785f04bfdf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:19.878225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531085bc-be08-4494-862b-785f04bfdf35 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:19.878510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531085bc-be08-4494-862b-785f04bfdf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:19.878785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531085bc-be08-4494-862b-785f04bfdf35 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:19.879545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531085bc-be08-4494-862b-785f04bfdf35 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:19.881243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531085bc-be08-4494-862b-785f04bfdf35 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:19.900833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 18/35] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jul 14 09:04:19 2022] POST /identity/v3/roles => generated 225 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:04:19.903278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531085bc-be08-4494-862b-785f04bfdf35 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:19.943405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:19.996954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3436a4d-504d-44bc-9e63-9f36d384706d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:20.016029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:20.040020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6d6f8-67cd-409e-a74a-56a73ace89d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:20.040798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6d6f8-67cd-409e-a74a-56a73ace89d2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.041232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6d6f8-67cd-409e-a74a-56a73ace89d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.041515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6d6f8-67cd-409e-a74a-56a73ace89d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.042315 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6d6f8-67cd-409e-a74a-56a73ace89d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:20.042625 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6d6f8-67cd-409e-a74a-56a73ace89d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:20.044504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6d6f8-67cd-409e-a74a-56a73ace89d2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:20.067778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 18/36] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:20.073619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6d6f8-67cd-409e-a74a-56a73ace89d2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:20.090744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531085bc-be08-4494-862b-785f04bfdf35 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:20.199400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6d6f8-67cd-409e-a74a-56a73ace89d2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:20.214640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809d15b-de54-43dc-91d3-14b4fc98bb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:20.215467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809d15b-de54-43dc-91d3-14b4fc98bb88 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.215751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809d15b-de54-43dc-91d3-14b4fc98bb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.216026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809d15b-de54-43dc-91d3-14b4fc98bb88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.217589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809d15b-de54-43dc-91d3-14b4fc98bb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:20.219057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809d15b-de54-43dc-91d3-14b4fc98bb88 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:20.220691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 19/37] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:20.229721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809d15b-de54-43dc-91d3-14b4fc98bb88 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:20.237374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d9836-9c3b-4559-a497-a544592aa612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:20.238140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d9836-9c3b-4559-a497-a544592aa612 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.238466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d9836-9c3b-4559-a497-a544592aa612 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.238796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d9836-9c3b-4559-a497-a544592aa612 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.239519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d9836-9c3b-4559-a497-a544592aa612 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:20.241014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d9836-9c3b-4559-a497-a544592aa612 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:20.369621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:20.375731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809d15b-de54-43dc-91d3-14b4fc98bb88 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:20.382307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 19/38] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:04:20 2022] POST /identity/v3/projects => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:04:20.384966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41123a4e-1e7f-4b66-9384-2a7aa43ac499 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.385267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41123a4e-1e7f-4b66-9384-2a7aa43ac499 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.385554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41123a4e-1e7f-4b66-9384-2a7aa43ac499 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.387177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 20/39] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:20.392941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba4531-8d96-47b4-a6d5-4eb810bad2b3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.393235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba4531-8d96-47b4-a6d5-4eb810bad2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.393520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba4531-8d96-47b4-a6d5-4eb810bad2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.422941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98464c27-6f4c-451c-9c18-c3547eb98611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:20.424359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98464c27-6f4c-451c-9c18-c3547eb98611 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.424949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98464c27-6f4c-451c-9c18-c3547eb98611 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.425430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98464c27-6f4c-451c-9c18-c3547eb98611 None admin] PATH_INFO: `/v3/domains/default/users/ed59d5d85ac94b5e83056380d59a4958/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.429167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98464c27-6f4c-451c-9c18-c3547eb98611 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ed59d5d85ac94b5e83056380d59a4958, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:20.431260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98464c27-6f4c-451c-9c18-c3547eb98611 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:20.452973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 20/40] 10.222.0.27 () {58 vars in 1361 bytes} [Thu Jul 14 09:04:20 2022] PUT /identity/v3/domains/default/users/ed59d5d85ac94b5e83056380d59a4958/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:04:20.473219 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23104-bbf0-485f-9ecc-c668d627adf8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.473588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23104-bbf0-485f-9ecc-c668d627adf8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.473791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23104-bbf0-485f-9ecc-c668d627adf8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.475340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 21/41] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:04:20.481524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01363827-5201-4c29-94f6-7b43e106642a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.481966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01363827-5201-4c29-94f6-7b43e106642a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.482357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01363827-5201-4c29-94f6-7b43e106642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.503025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-01363827-5201-4c29-94f6-7b43e106642a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:20.504887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-01363827-5201-4c29-94f6-7b43e106642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:20.559143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9cba4531-8d96-47b4-a6d5-4eb810bad2b3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:20.562026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9cba4531-8d96-47b4-a6d5-4eb810bad2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:20.591250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:20.600759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 22/42] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:20.623781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01363827-5201-4c29-94f6-7b43e106642a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:20.650829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 21/43] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:20.673959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba4531-8d96-47b4-a6d5-4eb810bad2b3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:20.735712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:20.754070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01363827-5201-4c29-94f6-7b43e106642a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:20.781344 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba4531-8d96-47b4-a6d5-4eb810bad2b3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:20.790084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd6642-7b25-4825-b480-36922bc025a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:20.790766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd6642-7b25-4825-b480-36922bc025a3 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.791053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd6642-7b25-4825-b480-36922bc025a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.791334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd6642-7b25-4825-b480-36922bc025a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.792138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd6642-7b25-4825-b480-36922bc025a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:20.793551 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd6642-7b25-4825-b480-36922bc025a3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:20.808074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jul 14 09:04:20 2022] POST /identity/v3/roles => generated 223 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:04:20.818745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29955f63-d6dc-4c6b-98c0-7fcafa377b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:20.819582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955f63-d6dc-4c6b-98c0-7fcafa377b64 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.819906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955f63-d6dc-4c6b-98c0-7fcafa377b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.820886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955f63-d6dc-4c6b-98c0-7fcafa377b64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.822278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29955f63-d6dc-4c6b-98c0-7fcafa377b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:20.823963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29955f63-d6dc-4c6b-98c0-7fcafa377b64 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:20.830814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 22/45] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:20.831826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd6642-7b25-4825-b480-36922bc025a3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:20.950316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd6642-7b25-4825-b480-36922bc025a3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:20.988908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781e57f-518e-4fc0-80d9-5359d3a96d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:20.989500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781e57f-518e-4fc0-80d9-5359d3a96d55 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:20.989782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781e57f-518e-4fc0-80d9-5359d3a96d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:20.990061 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781e57f-518e-4fc0-80d9-5359d3a96d55 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:20.990776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781e57f-518e-4fc0-80d9-5359d3a96d55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:20.992399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781e57f-518e-4fc0-80d9-5359d3a96d55 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:21.009581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:21.025327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:04:20 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:04:22.477815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e31f2-1807-4adc-bf8c-543b44d2a0d5 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:22.478371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e31f2-1807-4adc-bf8c-543b44d2a0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:22.478371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e31f2-1807-4adc-bf8c-543b44d2a0d5 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:22.479764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 23/47] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:22.485043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23840-23cd-4620-a329-2181aa1e2884 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:22.485477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23840-23cd-4620-a329-2181aa1e2884 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:22.485675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23840-23cd-4620-a329-2181aa1e2884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:22.502649 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-dcc23840-23cd-4620-a329-2181aa1e2884 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:22.503826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dcc23840-23cd-4620-a329-2181aa1e2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:22.573951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 25/48] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:22.596324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e31f2-1807-4adc-bf8c-543b44d2a0d5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:22.623994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:22.705999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e31f2-1807-4adc-bf8c-543b44d2a0d5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:22.742872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c010b-1c06-48da-8f37-17d7c7044642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:22.743672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c010b-1c06-48da-8f37-17d7c7044642 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:22.743951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c010b-1c06-48da-8f37-17d7c7044642 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:22.744222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c010b-1c06-48da-8f37-17d7c7044642 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:22.754800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c010b-1c06-48da-8f37-17d7c7044642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-896c010b-1c06-48da-8f37-17d7c7044642 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:22.762543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:22.763423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:22.764422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 24/49] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:22.769766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc23840-23cd-4620-a329-2181aa1e2884 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:22.868381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc23840-23cd-4620-a329-2181aa1e2884 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:22.893952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:22.903568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f156e8-ce8f-4c0e-a647-0135d723b7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:22.904272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f156e8-ce8f-4c0e-a647-0135d723b7bb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:22.904566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f156e8-ce8f-4c0e-a647-0135d723b7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:22.904870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f156e8-ce8f-4c0e-a647-0135d723b7bb None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:22.905736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f156e8-ce8f-4c0e-a647-0135d723b7bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:22.906045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f156e8-ce8f-4c0e-a647-0135d723b7bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:22.907924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f156e8-ce8f-4c0e-a647-0135d723b7bb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:22.920695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 26/50] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:22.926304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c010b-1c06-48da-8f37-17d7c7044642 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:23.016621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:23.033036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c010b-1c06-48da-8f37-17d7c7044642 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:23.068688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc40e89-18b2-4de0-a3e9-32df037897e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:23.069630 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc40e89-18b2-4de0-a3e9-32df037897e8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:23.069918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc40e89-18b2-4de0-a3e9-32df037897e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:23.070196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc40e89-18b2-4de0-a3e9-32df037897e8 None admin] PATH_INFO: `/v3/users/ed59d5d85ac94b5e83056380d59a4958` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:23.071454 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc40e89-18b2-4de0-a3e9-32df037897e8 None admin] RBAC: Authorizing `identity:get_user(user_id=ed59d5d85ac94b5e83056380d59a4958)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:23.072941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc40e89-18b2-4de0-a3e9-32df037897e8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:23.074586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 25/51] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:22 2022] GET /identity/v3/users/ed59d5d85ac94b5e83056380d59a4958 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:23.080322 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f156e8-ce8f-4c0e-a647-0135d723b7bb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:23.144558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf3d84-1af8-41a9-8e96-a5b1ced2a959 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:23.144878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf3d84-1af8-41a9-8e96-a5b1ced2a959 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:23.145159 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf3d84-1af8-41a9-8e96-a5b1ced2a959 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:23.146733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 26/52] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:04:23.152140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173097bc-ab50-43ee-b9e6-779f70ea7b14 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:23.152443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173097bc-ab50-43ee-b9e6-779f70ea7b14 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:23.152759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173097bc-ab50-43ee-b9e6-779f70ea7b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:23.170588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-173097bc-ab50-43ee-b9e6-779f70ea7b14 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:23.172118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-173097bc-ab50-43ee-b9e6-779f70ea7b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:23.191005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f156e8-ce8f-4c0e-a647-0135d723b7bb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:23.242787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 27/53] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:23.266792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173097bc-ab50-43ee-b9e6-779f70ea7b14 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:23.337928 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714178f3-3348-4e31-8881-852bd1fca77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:23.338724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714178f3-3348-4e31-8881-852bd1fca77a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:23.338993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714178f3-3348-4e31-8881-852bd1fca77a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:23.339270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714178f3-3348-4e31-8881-852bd1fca77a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:23.340471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714178f3-3348-4e31-8881-852bd1fca77a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:23.341963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714178f3-3348-4e31-8881-852bd1fca77a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:23.343581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 27/54] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:23.349591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714178f3-3348-4e31-8881-852bd1fca77a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:23.359922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:23.379941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173097bc-ab50-43ee-b9e6-779f70ea7b14 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:23.410471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:23.417147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b58cb-8f93-460e-9c82-d77ef8607363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:23.417960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b58cb-8f93-460e-9c82-d77ef8607363 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:23.418244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b58cb-8f93-460e-9c82-d77ef8607363 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:23.418524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b58cb-8f93-460e-9c82-d77ef8607363 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:23.419789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b58cb-8f93-460e-9c82-d77ef8607363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:23.421368 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b58cb-8f93-460e-9c82-d77ef8607363 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:23.423003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 28/55] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:23.429082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b58cb-8f93-460e-9c82-d77ef8607363 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:23.459283 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714178f3-3348-4e31-8881-852bd1fca77a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:23.494088 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92df20-b13f-4b86-8ada-58aedbd1a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:23.495040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92df20-b13f-4b86-8ada-58aedbd1a4fe None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:23.495040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92df20-b13f-4b86-8ada-58aedbd1a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:23.495329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92df20-b13f-4b86-8ada-58aedbd1a4fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:23.496140 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92df20-b13f-4b86-8ada-58aedbd1a4fe None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.domain.id=default, user.id=ed59d5d85ac94b5e83056380d59a4958) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:23.496464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92df20-b13f-4b86-8ada-58aedbd1a4fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:23.497978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92df20-b13f-4b86-8ada-58aedbd1a4fe None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:23.507051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 28/56] 10.222.0.27 () {56 vars in 1322 bytes} [Thu Jul 14 09:04:23 2022] GET /identity/v3/role_assignments?user.id=ed59d5d85ac94b5e83056380d59a4958&scope.domain.id=default&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:23.538960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b58cb-8f93-460e-9c82-d77ef8607363 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:23.579624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e47aa-9535-4da0-8b56-6a8ce9123ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:23.580303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e47aa-9535-4da0-8b56-6a8ce9123ea6 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:23.580605 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e47aa-9535-4da0-8b56-6a8ce9123ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:23.580898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e47aa-9535-4da0-8b56-6a8ce9123ea6 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:23.581626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e47aa-9535-4da0-8b56-6a8ce9123ea6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:23.583118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e47aa-9535-4da0-8b56-6a8ce9123ea6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:23.615366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 29/57] 10.222.0.27 () {60 vars in 1140 bytes} [Thu Jul 14 09:04:23 2022] POST /identity/v3/projects => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:04:25.655091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81e26-c58c-4537-b6cb-9be4c9015401 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:25.655601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81e26-c58c-4537-b6cb-9be4c9015401 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:25.655601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81e26-c58c-4537-b6cb-9be4c9015401 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:25.656975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 29/58] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:25.663269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d574e98-0334-4589-ad4e-8cbd9f6c8461 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:25.663945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d574e98-0334-4589-ad4e-8cbd9f6c8461 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:25.664200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d574e98-0334-4589-ad4e-8cbd9f6c8461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:25.674546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:25.687991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6d574e98-0334-4589-ad4e-8cbd9f6c8461 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:25.689231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6d574e98-0334-4589-ad4e-8cbd9f6c8461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:25.760091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 30/59] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:25.785306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a81e26-c58c-4537-b6cb-9be4c9015401 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:25.900452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a81e26-c58c-4537-b6cb-9be4c9015401 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:25.926239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:25.942685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb4550-36d8-448d-bfe9-02e429ee98d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:25.943482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb4550-36d8-448d-bfe9-02e429ee98d3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:25.943832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb4550-36d8-448d-bfe9-02e429ee98d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:25.944276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb4550-36d8-448d-bfe9-02e429ee98d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:25.945486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb4550-36d8-448d-bfe9-02e429ee98d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:25.946939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb4550-36d8-448d-bfe9-02e429ee98d3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:25.948586 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 30/60] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:25.954374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d574e98-0334-4589-ad4e-8cbd9f6c8461 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:26.074155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d574e98-0334-4589-ad4e-8cbd9f6c8461 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:26.112506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d54299-f561-4413-8d27-97eb7bcb12cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:26.113164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d54299-f561-4413-8d27-97eb7bcb12cd None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:26.113500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d54299-f561-4413-8d27-97eb7bcb12cd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:26.113793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d54299-f561-4413-8d27-97eb7bcb12cd None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:26.114516 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d54299-f561-4413-8d27-97eb7bcb12cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:26.116175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d54299-f561-4413-8d27-97eb7bcb12cd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:26.124780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:26.147612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 31/61] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:04:25 2022] POST /identity/v3/users => generated 275 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:04:29.258736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddb538-d032-4cec-a588-862448a1e55e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.259782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddb538-d032-4cec-a588-862448a1e55e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.260261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddb538-d032-4cec-a588-862448a1e55e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.261877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 31/62] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:29.267307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a7e46-547e-470c-97e4-76a87ce2c7b1 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.268093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a7e46-547e-470c-97e4-76a87ce2c7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.268598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a7e46-547e-470c-97e4-76a87ce2c7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.291532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-965a7e46-547e-470c-97e4-76a87ce2c7b1 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:29.293084 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-965a7e46-547e-470c-97e4-76a87ce2c7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:29.382481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 32/63] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:29.410957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ed647-7661-47d1-8d11-6af6599ffb3e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.411652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ed647-7661-47d1-8d11-6af6599ffb3e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.412141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ed647-7661-47d1-8d11-6af6599ffb3e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.413736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 32/64] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:29.419108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91edc6f-0ff8-4530-9ec8-f37856bd6cf8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.419401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91edc6f-0ff8-4530-9ec8-f37856bd6cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.419682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91edc6f-0ff8-4530-9ec8-f37856bd6cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.423291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ed647-7661-47d1-8d11-6af6599ffb3e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:29.452213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b91edc6f-0ff8-4530-9ec8-f37856bd6cf8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:29.453941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b91edc6f-0ff8-4530-9ec8-f37856bd6cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:29.557974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 33/65] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:29.584352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ed647-7661-47d1-8d11-6af6599ffb3e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:29.593973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91edc6f-0ff8-4530-9ec8-f37856bd6cf8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:29.655194 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c3112-41f5-4be3-a2ad-1cd4e69c8c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:29.656021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c3112-41f5-4be3-a2ad-1cd4e69c8c19 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.656313 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c3112-41f5-4be3-a2ad-1cd4e69c8c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.656592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c3112-41f5-4be3-a2ad-1cd4e69c8c19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.666557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:29.685781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c3112-41f5-4be3-a2ad-1cd4e69c8c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d67c3112-41f5-4be3-a2ad-1cd4e69c8c19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:29.695074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:29.695977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 33/66] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:04:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:04:29.701164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322f85e-1f6b-4f9b-b71f-bba34e4db7e8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.701874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322f85e-1f6b-4f9b-b71f-bba34e4db7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.701874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322f85e-1f6b-4f9b-b71f-bba34e4db7e8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.701874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 34/67] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:29.701874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67187dbb-09d2-417a-a0d2-5e47db0dd031 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.701874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67187dbb-09d2-417a-a0d2-5e47db0dd031 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.701874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67187dbb-09d2-417a-a0d2-5e47db0dd031 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.702523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 35/68] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:29.705014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fc86-7763-4ca0-b339-6312dbee3299 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.705316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fc86-7763-4ca0-b339-6312dbee3299 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.705591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fc86-7763-4ca0-b339-6312dbee3299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.723282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4ca4fc86-7763-4ca0-b339-6312dbee3299 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:29.724723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4ca4fc86-7763-4ca0-b339-6312dbee3299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:29.730911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91edc6f-0ff8-4530-9ec8-f37856bd6cf8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:29.765770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd16e8-53a7-4192-be17-e20db12bb8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:29.766571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd16e8-53a7-4192-be17-e20db12bb8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.766860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd16e8-53a7-4192-be17-e20db12bb8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.767145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd16e8-53a7-4192-be17-e20db12bb8e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.771251 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:29.778425 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd16e8-53a7-4192-be17-e20db12bb8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d9dd16e8-53a7-4192-be17-e20db12bb8e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:29.786099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:29.787042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:29.787797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:04:29.788440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd16e8-53a7-4192-be17-e20db12bb8e0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:29.799354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 36/70] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:29.801019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d8e82-6c88-4470-ab2c-eb6c7aa16ea2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.801454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d8e82-6c88-4470-ab2c-eb6c7aa16ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.801891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d8e82-6c88-4470-ab2c-eb6c7aa16ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.827463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6b3d8e82-6c88-4470-ab2c-eb6c7aa16ea2 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:29.828978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6b3d8e82-6c88-4470-ab2c-eb6c7aa16ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:29.900503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd16e8-53a7-4192-be17-e20db12bb8e0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:29.902666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 37/71] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:29.909629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d8e82-6c88-4470-ab2c-eb6c7aa16ea2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:29.911909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:29.938079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69f9c-57a9-4209-ad62-689d788a5e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:29.938763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69f9c-57a9-4209-ad62-689d788a5e35 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:29.939051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69f9c-57a9-4209-ad62-689d788a5e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:29.939329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69f9c-57a9-4209-ad62-689d788a5e35 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:29.940091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b69f9c-57a9-4209-ad62-689d788a5e35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:29.940402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b69f9c-57a9-4209-ad62-689d788a5e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:29.941841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b69f9c-57a9-4209-ad62-689d788a5e35 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:29.950177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 35/72] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:29.950966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69f9c-57a9-4209-ad62-689d788a5e35 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:30.013015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d8e82-6c88-4470-ab2c-eb6c7aa16ea2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.022138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:30.048339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b306b-f440-490d-8b4f-72ed4c952f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.049269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b306b-f440-490d-8b4f-72ed4c952f13 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.049724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b306b-f440-490d-8b4f-72ed4c952f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.050318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b306b-f440-490d-8b4f-72ed4c952f13 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.051087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b306b-f440-490d-8b4f-72ed4c952f13 None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:30.051396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b306b-f440-490d-8b4f-72ed4c952f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:30.052864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b306b-f440-490d-8b4f-72ed4c952f13 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:30.055232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69f9c-57a9-4209-ad62-689d788a5e35 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.061053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 38/73] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:30.062300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5eccd-936c-42e9-9159-18285ba32355 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.062589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5eccd-936c-42e9-9159-18285ba32355 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.062868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5eccd-936c-42e9-9159-18285ba32355 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.064105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 39/74] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:30.064842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5eccd-936c-42e9-9159-18285ba32355 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:30.093322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88cae3-cd59-4dfc-930e-3b61667affb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.094072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88cae3-cd59-4dfc-930e-3b61667affb4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.094358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88cae3-cd59-4dfc-930e-3b61667affb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.094637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88cae3-cd59-4dfc-930e-3b61667affb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.104858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88cae3-cd59-4dfc-930e-3b61667affb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-0f88cae3-cd59-4dfc-930e-3b61667affb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:30.113183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:30.114069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:30.114897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 36/75] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:04:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:30.115679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88cae3-cd59-4dfc-930e-3b61667affb4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:30.147572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:30.168399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5eccd-936c-42e9-9159-18285ba32355 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.201860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcee73-6b5c-478d-aeee-a21a1da156e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.202684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcee73-6b5c-478d-aeee-a21a1da156e8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.202964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcee73-6b5c-478d-aeee-a21a1da156e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.203237 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcee73-6b5c-478d-aeee-a21a1da156e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.213741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcee73-6b5c-478d-aeee-a21a1da156e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:30.217078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88cae3-cd59-4dfc-930e-3b61667affb4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-7fdcee73-6b5c-478d-aeee-a21a1da156e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:30.221385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:30.222287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:30.223051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 40/76] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:30.225148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcee73-6b5c-478d-aeee-a21a1da156e8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:30.250180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e32c24-329a-4053-b716-461bcf0051b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.251075 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32c24-329a-4053-b716-461bcf0051b5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.251366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32c24-329a-4053-b716-461bcf0051b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.251646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32c24-329a-4053-b716-461bcf0051b5 None admin] PATH_INFO: `/v3/users/ed59d5d85ac94b5e83056380d59a4958` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.252881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e32c24-329a-4053-b716-461bcf0051b5 None admin] RBAC: Authorizing `identity:get_user(user_id=ed59d5d85ac94b5e83056380d59a4958)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:30.254332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e32c24-329a-4053-b716-461bcf0051b5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:30.255503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:30.256178 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 37/77] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:30 2022] GET /identity/v3/users/ed59d5d85ac94b5e83056380d59a4958 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:30.257158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a107-366f-419a-8765-1ed1071ed721 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.257452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a107-366f-419a-8765-1ed1071ed721 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.257769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a107-366f-419a-8765-1ed1071ed721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.273899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-acb9a107-366f-419a-8765-1ed1071ed721 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:30.275097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-acb9a107-366f-419a-8765-1ed1071ed721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:30.330309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcee73-6b5c-478d-aeee-a21a1da156e8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.341096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 38/78] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:30.341931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9a107-366f-419a-8765-1ed1071ed721 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:30.372929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:30.373948 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e495-7ee5-467f-bf93-5c9603519cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.374857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e495-7ee5-467f-bf93-5c9603519cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.375174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e495-7ee5-467f-bf93-5c9603519cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.375428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e495-7ee5-467f-bf93-5c9603519cf2 None admin] PATH_INFO: `/v3/users/1829e1ee957144f7aae3cc64ec22ab1a` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.391471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142e495-7ee5-467f-bf93-5c9603519cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=1829e1ee957144f7aae3cc64ec22ab1a)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:30.392975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142e495-7ee5-467f-bf93-5c9603519cf2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:30.394678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 41/79] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:30 2022] GET /identity/v3/users/1829e1ee957144f7aae3cc64ec22ab1a => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:30.395434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e495-7ee5-467f-bf93-5c9603519cf2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:30.449801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9a107-366f-419a-8765-1ed1071ed721 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.484679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdffbc-c361-46ae-97e5-ce07e6d75b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.485354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdffbc-c361-46ae-97e5-ce07e6d75b0b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.485914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdffbc-c361-46ae-97e5-ce07e6d75b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.486029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:30.486112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdffbc-c361-46ae-97e5-ce07e6d75b0b None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.486789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdffbc-c361-46ae-97e5-ce07e6d75b0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:30.487136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdffbc-c361-46ae-97e5-ce07e6d75b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:30.488791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdffbc-c361-46ae-97e5-ce07e6d75b0b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:30.497196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 39/80] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:04:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:30.498157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdffbc-c361-46ae-97e5-ce07e6d75b0b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:30.499346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e495-7ee5-467f-bf93-5c9603519cf2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.533791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e70b69-2075-4b20-855f-b1f3c5b73284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.534460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e70b69-2075-4b20-855f-b1f3c5b73284 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.534750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e70b69-2075-4b20-855f-b1f3c5b73284 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.535035 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e70b69-2075-4b20-855f-b1f3c5b73284 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.535802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e70b69-2075-4b20-855f-b1f3c5b73284 None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:30.536114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e70b69-2075-4b20-855f-b1f3c5b73284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:30.537627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e70b69-2075-4b20-855f-b1f3c5b73284 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:30.545807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 42/81] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:30.546584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e70b69-2075-4b20-855f-b1f3c5b73284 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:30.592618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:30.604057 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdffbc-c361-46ae-97e5-ce07e6d75b0b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.638588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98432b03-21df-4ef9-a2d9-d7c2a718bce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.639175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98432b03-21df-4ef9-a2d9-d7c2a718bce9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.639455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98432b03-21df-4ef9-a2d9-d7c2a718bce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.639728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98432b03-21df-4ef9-a2d9-d7c2a718bce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.650039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e70b69-2075-4b20-855f-b1f3c5b73284 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.683068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d75dd-4035-4773-9072-269e54bc918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.683876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d75dd-4035-4773-9072-269e54bc918b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.684164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d75dd-4035-4773-9072-269e54bc918b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.684439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d75dd-4035-4773-9072-269e54bc918b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.685736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d75dd-4035-4773-9072-269e54bc918b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:30.687196 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d75dd-4035-4773-9072-269e54bc918b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:30.688878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 43/82] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:30.689648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d75dd-4035-4773-9072-269e54bc918b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:30.709606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:30.713560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98432b03-21df-4ef9-a2d9-d7c2a718bce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:30.715051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98432b03-21df-4ef9-a2d9-d7c2a718bce9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:30.795861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d75dd-4035-4773-9072-269e54bc918b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.809912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:30.819765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 40/83] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:30.820579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98432b03-21df-4ef9-a2d9-d7c2a718bce9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:30.830277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb628823-5f9f-4b10-9533-72f274ae9b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.830953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb628823-5f9f-4b10-9533-72f274ae9b0b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.831238 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb628823-5f9f-4b10-9533-72f274ae9b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.831514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb628823-5f9f-4b10-9533-72f274ae9b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.898969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb628823-5f9f-4b10-9533-72f274ae9b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:30.900353 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb628823-5f9f-4b10-9533-72f274ae9b0b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:30.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:30.920911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98432b03-21df-4ef9-a2d9-d7c2a718bce9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:30.955228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb6568-f476-4050-937e-f0e4c137b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:30.956119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6568-f476-4050-937e-f0e4c137b82b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:30.956402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6568-f476-4050-937e-f0e4c137b82b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:30.956701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6568-f476-4050-937e-f0e4c137b82b None admin] PATH_INFO: `/v3/users/1829e1ee957144f7aae3cc64ec22ab1a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:30.957918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb6568-f476-4050-937e-f0e4c137b82b None admin] RBAC: Authorizing `identity:get_user(user_id=1829e1ee957144f7aae3cc64ec22ab1a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:30.959392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb6568-f476-4050-937e-f0e4c137b82b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:30.961063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 41/84] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:30 2022] GET /identity/v3/users/1829e1ee957144f7aae3cc64ec22ab1a => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:30.961823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb6568-f476-4050-937e-f0e4c137b82b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:31.005640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 44/85] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:31.006458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb628823-5f9f-4b10-9533-72f274ae9b0b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:31.021511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:31.063326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb6568-f476-4050-937e-f0e4c137b82b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:31.096996 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a816bea-66c5-4a3b-823e-5d552f1bb7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:31.097865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816bea-66c5-4a3b-823e-5d552f1bb7df None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:31.098143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816bea-66c5-4a3b-823e-5d552f1bb7df None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:31.098416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816bea-66c5-4a3b-823e-5d552f1bb7df None admin] PATH_INFO: `/v3/users/1829e1ee957144f7aae3cc64ec22ab1a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:31.099865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a816bea-66c5-4a3b-823e-5d552f1bb7df None admin] RBAC: Authorizing `identity:get_user(user_id=1829e1ee957144f7aae3cc64ec22ab1a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:31.101347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a816bea-66c5-4a3b-823e-5d552f1bb7df None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:31.103187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 42/86] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:30 2022] GET /identity/v3/users/1829e1ee957144f7aae3cc64ec22ab1a => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:31.103745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a816bea-66c5-4a3b-823e-5d552f1bb7df None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:31.111390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb628823-5f9f-4b10-9533-72f274ae9b0b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:31.129885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:31.148079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8ebc3-00d4-4db7-8011-ff26e0cc7080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:31.148783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ebc3-00d4-4db7-8011-ff26e0cc7080 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:31.149120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ebc3-00d4-4db7-8011-ff26e0cc7080 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:31.149347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ebc3-00d4-4db7-8011-ff26e0cc7080 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:31.150072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8ebc3-00d4-4db7-8011-ff26e0cc7080 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:31.151499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8ebc3-00d4-4db7-8011-ff26e0cc7080 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:31.179119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 45/87] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:04:31 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:04:31.179839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8ebc3-00d4-4db7-8011-ff26e0cc7080 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:31.206429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a816bea-66c5-4a3b-823e-5d552f1bb7df None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:31.238176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:31.249029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575566-4cfc-428b-886c-45a1966feec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:31.250461 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575566-4cfc-428b-886c-45a1966feec7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:31.250853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575566-4cfc-428b-886c-45a1966feec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:31.251115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575566-4cfc-428b-886c-45a1966feec7 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:31.252563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83575566-4cfc-428b-886c-45a1966feec7 None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:31.254096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83575566-4cfc-428b-886c-45a1966feec7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:31.256146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 43/88] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:31 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:31.258283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575566-4cfc-428b-886c-45a1966feec7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:31.301862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8ebc3-00d4-4db7-8011-ff26e0cc7080 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:31.340701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca28b6-32e7-49db-b585-199ab82ba912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:31.342094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca28b6-32e7-49db-b585-199ab82ba912 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:31.342094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca28b6-32e7-49db-b585-199ab82ba912 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:31.342094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca28b6-32e7-49db-b585-199ab82ba912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:31.386389 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575566-4cfc-428b-886c-45a1966feec7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:31.392298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:31.430551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb6991-bb78-4c34-a4b7-9997e9938d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:31.431374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6991-bb78-4c34-a4b7-9997e9938d2b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:31.431661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6991-bb78-4c34-a4b7-9997e9938d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:31.432077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6991-bb78-4c34-a4b7-9997e9938d2b None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:31.433180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca28b6-32e7-49db-b585-199ab82ba912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:31.433338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb6991-bb78-4c34-a4b7-9997e9938d2b None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:31.434812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb6991-bb78-4c34-a4b7-9997e9938d2b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:31.435084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca28b6-32e7-49db-b585-199ab82ba912 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:31.436764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 44/89] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:31 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:31.437350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb6991-bb78-4c34-a4b7-9997e9938d2b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:31.522099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:31.558726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 46/90] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:31.559591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca28b6-32e7-49db-b585-199ab82ba912 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:31.571493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb6991-bb78-4c34-a4b7-9997e9938d2b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:31.617230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f3266-57a8-42d0-a3ed-8475f810fb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:31.617901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f3266-57a8-42d0-a3ed-8475f810fb67 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:31.618187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f3266-57a8-42d0-a3ed-8475f810fb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:31.618510 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f3266-57a8-42d0-a3ed-8475f810fb67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:31.643556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:31.676015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca28b6-32e7-49db-b585-199ab82ba912 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:31.713259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f3266-57a8-42d0-a3ed-8475f810fb67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:31.715395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f3266-57a8-42d0-a3ed-8475f810fb67 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:31.726556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf684bad-481c-427c-8d24-152f12991f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:31.727763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf684bad-481c-427c-8d24-152f12991f34 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:31.728158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf684bad-481c-427c-8d24-152f12991f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:31.728534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf684bad-481c-427c-8d24-152f12991f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:31.730120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf684bad-481c-427c-8d24-152f12991f34 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=b77ea42af6f745e0af87a131f9212231, user.id=ed59d5d85ac94b5e83056380d59a4958) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:31.730570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf684bad-481c-427c-8d24-152f12991f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:31.732632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf684bad-481c-427c-8d24-152f12991f34 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:31.740616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 47/91] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:31 2022] GET /identity/v3/role_assignments?user.id=ed59d5d85ac94b5e83056380d59a4958&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:31.741877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf684bad-481c-427c-8d24-152f12991f34 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:31.833213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:31.847898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 45/92] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:31.848920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f3266-57a8-42d0-a3ed-8475f810fb67 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:31.963093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f3266-57a8-42d0-a3ed-8475f810fb67 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:32.007022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4cdf0-0b10-4336-8616-84409cb91502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:32.007835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4cdf0-0b10-4336-8616-84409cb91502 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:32.008120 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4cdf0-0b10-4336-8616-84409cb91502 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:32.008398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4cdf0-0b10-4336-8616-84409cb91502 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:32.008715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf684bad-481c-427c-8d24-152f12991f34 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:32.009643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4cdf0-0b10-4336-8616-84409cb91502 None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:32.012348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4cdf0-0b10-4336-8616-84409cb91502 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:32.014502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 46/93] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:31 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:32.015356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4cdf0-0b10-4336-8616-84409cb91502 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:32.073102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:32.123116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4cdf0-0b10-4336-8616-84409cb91502 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:32.126010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a04b01-e062-4134-94f2-6aa7c31b473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:32.127125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a04b01-e062-4134-94f2-6aa7c31b473b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:32.127125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a04b01-e062-4134-94f2-6aa7c31b473b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:32.127402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a04b01-e062-4134-94f2-6aa7c31b473b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:32.128271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a04b01-e062-4134-94f2-6aa7c31b473b None admin] RBAC: Adding query filter params (role.id=1790dd5eeda1419ca41830c6448c63fe, scope.project.id=b77ea42af6f745e0af87a131f9212231, user.id=1829e1ee957144f7aae3cc64ec22ab1a) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:32.128592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a04b01-e062-4134-94f2-6aa7c31b473b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:32.130354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a04b01-e062-4134-94f2-6aa7c31b473b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:32.136478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 48/94] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:31 2022] GET /identity/v3/role_assignments?user.id=1829e1ee957144f7aae3cc64ec22ab1a&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 259 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:32.145654 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a04b01-e062-4134-94f2-6aa7c31b473b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:32.148645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:32.165625 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41592db-9ea5-4d65-8c51-c75fc8634d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:32.166839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41592db-9ea5-4d65-8c51-c75fc8634d1a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:32.167295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41592db-9ea5-4d65-8c51-c75fc8634d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:32.167765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41592db-9ea5-4d65-8c51-c75fc8634d1a None admin] PATH_INFO: `/v3/projects/c17fb68ad7db4a01a655588cdbabf576` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:32.169272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41592db-9ea5-4d65-8c51-c75fc8634d1a None admin] RBAC: Authorizing `identity:get_project(project_id=c17fb68ad7db4a01a655588cdbabf576)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:32.171019 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41592db-9ea5-4d65-8c51-c75fc8634d1a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:32.173047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 47/95] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:32 2022] GET /identity/v3/projects/c17fb68ad7db4a01a655588cdbabf576 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:32.181858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41592db-9ea5-4d65-8c51-c75fc8634d1a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:32.263069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a04b01-e062-4134-94f2-6aa7c31b473b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:32.299910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f339a0-e18d-4469-bf9b-fa0143c8019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:32.300801 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f339a0-e18d-4469-bf9b-fa0143c8019b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:32.300976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f339a0-e18d-4469-bf9b-fa0143c8019b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:32.301217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f339a0-e18d-4469-bf9b-fa0143c8019b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:32.302132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f339a0-e18d-4469-bf9b-fa0143c8019b None admin] RBAC: Adding query filter params (role.id=45788771d2f1494a801cc09d365ff9e2, scope.project.id=b77ea42af6f745e0af87a131f9212231, user.id=1829e1ee957144f7aae3cc64ec22ab1a) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:32.302462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f339a0-e18d-4469-bf9b-fa0143c8019b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:32.304098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f339a0-e18d-4469-bf9b-fa0143c8019b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:32.310571 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 49/96] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:32 2022] GET /identity/v3/role_assignments?user.id=1829e1ee957144f7aae3cc64ec22ab1a&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=45788771d2f1494a801cc09d365ff9e2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:32.440526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:32.445350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41592db-9ea5-4d65-8c51-c75fc8634d1a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:32.502497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9d09f-1a39-4040-be1f-7ed79cc63471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:32.503177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9d09f-1a39-4040-be1f-7ed79cc63471 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:32.503467 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9d09f-1a39-4040-be1f-7ed79cc63471 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:32.503749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9d09f-1a39-4040-be1f-7ed79cc63471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:32.504873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9d09f-1a39-4040-be1f-7ed79cc63471 None admin] RBAC: Adding query filter params (role.id=1790dd5eeda1419ca41830c6448c63fe, scope.project.id=c17fb68ad7db4a01a655588cdbabf576, user.id=1829e1ee957144f7aae3cc64ec22ab1a) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:32.504977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9d09f-1a39-4040-be1f-7ed79cc63471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:32.506453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9d09f-1a39-4040-be1f-7ed79cc63471 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:32.517262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 48/97] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:32 2022] GET /identity/v3/role_assignments?user.id=1829e1ee957144f7aae3cc64ec22ab1a&scope.project.id=c17fb68ad7db4a01a655588cdbabf576&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:33.889314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09732-a013-4660-98e4-9402276b4c88 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:33.889830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09732-a013-4660-98e4-9402276b4c88 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:33.889928 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09732-a013-4660-98e4-9402276b4c88 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:33.891372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 50/98] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:33.902022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb253a2-c24a-4ef9-8384-44849c9ec1e6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:33.902426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb253a2-c24a-4ef9-8384-44849c9ec1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:33.902624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb253a2-c24a-4ef9-8384-44849c9ec1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:33.929714 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-bbb253a2-c24a-4ef9-8384-44849c9ec1e6 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:33.930945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bbb253a2-c24a-4ef9-8384-44849c9ec1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:34.020747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:34.055475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce09732-a013-4660-98e4-9402276b4c88 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:34.144989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:34.146918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a77f1-2cdd-443f-8021-ef5879850933 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:34.147403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a77f1-2cdd-443f-8021-ef5879850933 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:34.147832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a77f1-2cdd-443f-8021-ef5879850933 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:34.149445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 50/100] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:34.154905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfd52d-774d-4a48-9e98-7678ad9ea68f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:34.155470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfd52d-774d-4a48-9e98-7678ad9ea68f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:34.155937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfd52d-774d-4a48-9e98-7678ad9ea68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:34.175092 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ebbfd52d-774d-4a48-9e98-7678ad9ea68f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:34.176866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ebbfd52d-774d-4a48-9e98-7678ad9ea68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:34.215637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce09732-a013-4660-98e4-9402276b4c88 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:34.283213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4aac3-07e1-450a-ac52-4e57824f1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:34.284369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4aac3-07e1-450a-ac52-4e57824f1224 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:34.284874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4aac3-07e1-450a-ac52-4e57824f1224 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:34.285342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4aac3-07e1-450a-ac52-4e57824f1224 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:34.296768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4aac3-07e1-450a-ac52-4e57824f1224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-39f4aac3-07e1-450a-ac52-4e57824f1224 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:34.305253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:34.306101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:34.306860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:34.309337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 51/101] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:34.310974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 51/102] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:34.315277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4aac3-07e1-450a-ac52-4e57824f1224 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:34.404105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfd52d-774d-4a48-9e98-7678ad9ea68f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:34.445674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4aac3-07e1-450a-ac52-4e57824f1224 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:34.449616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:34.472701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:34.492404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78299c58-c1f1-4b3d-a333-a5ea47b0f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:34.493323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78299c58-c1f1-4b3d-a333-a5ea47b0f8ba None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:34.493743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78299c58-c1f1-4b3d-a333-a5ea47b0f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:34.494154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78299c58-c1f1-4b3d-a333-a5ea47b0f8ba None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:34.495069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78299c58-c1f1-4b3d-a333-a5ea47b0f8ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:34.496306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78299c58-c1f1-4b3d-a333-a5ea47b0f8ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:34.497866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78299c58-c1f1-4b3d-a333-a5ea47b0f8ba None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:34.515736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 52/103] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:34.522536 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78299c58-c1f1-4b3d-a333-a5ea47b0f8ba None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:34.624548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfd52d-774d-4a48-9e98-7678ad9ea68f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:34.632648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78299c58-c1f1-4b3d-a333-a5ea47b0f8ba None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:34.670567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd9d74-664d-420c-bc5f-5651c554a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:34.673314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9d74-664d-420c-bc5f-5651c554a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:34.675352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9d74-664d-420c-bc5f-5651c554a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:34.675789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9d74-664d-420c-bc5f-5651c554a5e6 None admin] PATH_INFO: `/v3/users/56938789392a4d5992c5aab53eb62da1` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:34.694654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2f110-ca78-43f4-872a-1b86e46c7848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:34.695683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f110-ca78-43f4-872a-1b86e46c7848 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:34.696333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f110-ca78-43f4-872a-1b86e46c7848 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:34.697801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f110-ca78-43f4-872a-1b86e46c7848 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:34.699194 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2f110-ca78-43f4-872a-1b86e46c7848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:34.701724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2f110-ca78-43f4-872a-1b86e46c7848 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:34.705723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd9d74-664d-420c-bc5f-5651c554a5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=56938789392a4d5992c5aab53eb62da1)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:34.707432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd9d74-664d-420c-bc5f-5651c554a5e6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:34.707917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 52/104] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:34.709286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c5a42-2dae-420b-9196-941fc4dca27d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:34.711135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 53/105] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:34 2022] GET /identity/v3/users/56938789392a4d5992c5aab53eb62da1 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:34.711611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c5a42-2dae-420b-9196-941fc4dca27d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:34.712025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c5a42-2dae-420b-9196-941fc4dca27d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:34.713484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 53/106] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:34.714385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd9d74-664d-420c-bc5f-5651c554a5e6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:34.722190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa925d38-5f8c-408c-b895-5dd51ba34c44 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:34.722631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa925d38-5f8c-408c-b895-5dd51ba34c44 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:34.723072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa925d38-5f8c-408c-b895-5dd51ba34c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:34.756117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-aa925d38-5f8c-408c-b895-5dd51ba34c44 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:34.758485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-aa925d38-5f8c-408c-b895-5dd51ba34c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:34.818324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:34.896950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 54/107] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:34.897880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa925d38-5f8c-408c-b895-5dd51ba34c44 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:34.935945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd9d74-664d-420c-bc5f-5651c554a5e6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:34.957070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:34.987498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c19a94-6d40-4584-bf89-aebe9f2b5252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:34.989265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c19a94-6d40-4584-bf89-aebe9f2b5252 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:34.989805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c19a94-6d40-4584-bf89-aebe9f2b5252 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:34.990228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c19a94-6d40-4584-bf89-aebe9f2b5252 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:34.991186 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c19a94-6d40-4584-bf89-aebe9f2b5252 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:34.992842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c19a94-6d40-4584-bf89-aebe9f2b5252 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:35.026164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 54/108] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:04:34 2022] POST /identity/v3/projects => generated 302 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:04:35.032916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c19a94-6d40-4584-bf89-aebe9f2b5252 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:35.064107 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa925d38-5f8c-408c-b895-5dd51ba34c44 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:35.115261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becb3f4-5a52-4507-83f2-216970152e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:35.116750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becb3f4-5a52-4507-83f2-216970152e3a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.117219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becb3f4-5a52-4507-83f2-216970152e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.117751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becb3f4-5a52-4507-83f2-216970152e3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.206570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becb3f4-5a52-4507-83f2-216970152e3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:35.209260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becb3f4-5a52-4507-83f2-216970152e3a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:35.237671 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:35.254128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:35.266916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c19a94-6d40-4584-bf89-aebe9f2b5252 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:35.334375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439adfb8-80fb-4d9d-836b-109b83831d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:35.335194 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439adfb8-80fb-4d9d-836b-109b83831d2b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.335482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439adfb8-80fb-4d9d-836b-109b83831d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.335760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439adfb8-80fb-4d9d-836b-109b83831d2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.336506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 55/109] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:35.338283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c4b2-0378-42f5-9392-65d7b5c7eb5c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.338777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c4b2-0378-42f5-9392-65d7b5c7eb5c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.339400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c4b2-0378-42f5-9392-65d7b5c7eb5c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.340932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 56/110] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:35.346087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199c4b2-0378-42f5-9392-65d7b5c7eb5c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:35.354424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439adfb8-80fb-4d9d-836b-109b83831d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-439adfb8-80fb-4d9d-836b-109b83831d2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:35.362651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:35.363585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 55/111] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:04:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:35.368916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987041ec-3a69-4164-bbb1-792f0d1d64eb None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.369788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987041ec-3a69-4164-bbb1-792f0d1d64eb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.369788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987041ec-3a69-4164-bbb1-792f0d1d64eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.387303 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-987041ec-3a69-4164-bbb1-792f0d1d64eb None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:35.388559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-987041ec-3a69-4164-bbb1-792f0d1d64eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:35.466141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 56/112] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:35.466995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987041ec-3a69-4164-bbb1-792f0d1d64eb None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:35.473555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199c4b2-0378-42f5-9392-65d7b5c7eb5c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:35.499570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:35.511341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355e27-56c8-46ef-b993-fc613711d4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:35.512213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355e27-56c8-46ef-b993-fc613711d4aa None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.512496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355e27-56c8-46ef-b993-fc613711d4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.512800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355e27-56c8-46ef-b993-fc613711d4aa None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.514038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6355e27-56c8-46ef-b993-fc613711d4aa None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:35.515499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6355e27-56c8-46ef-b993-fc613711d4aa None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:35.517296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 57/113] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:35 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:35.518605 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b77b-34ea-4179-a04e-aff2455410a9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.518894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b77b-34ea-4179-a04e-aff2455410a9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.519174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b77b-34ea-4179-a04e-aff2455410a9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.524476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 58/114] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:35.524476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2092-c41b-47f8-b09d-160196b49052 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.524476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2092-c41b-47f8-b09d-160196b49052 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.524476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2092-c41b-47f8-b09d-160196b49052 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.524476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 59/115] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:35.524848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc2092-c41b-47f8-b09d-160196b49052 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:35.577186 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:35.592311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987041ec-3a69-4164-bbb1-792f0d1d64eb None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:35.631380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71f117-5341-4404-b6c6-7309b592bd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:35.632062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71f117-5341-4404-b6c6-7309b592bd5a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.632347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71f117-5341-4404-b6c6-7309b592bd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.632618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71f117-5341-4404-b6c6-7309b592bd5a None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.633434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71f117-5341-4404-b6c6-7309b592bd5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:35.633735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc2092-c41b-47f8-b09d-160196b49052 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:35.633850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71f117-5341-4404-b6c6-7309b592bd5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:35.635121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71f117-5341-4404-b6c6-7309b592bd5a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:35.648697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 57/116] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:35.648697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71f117-5341-4404-b6c6-7309b592bd5a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:35.676371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5dfc-f328-4da4-bae7-3ea558e67ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:35.677627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5dfc-f328-4da4-bae7-3ea558e67ecb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.677910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5dfc-f328-4da4-bae7-3ea558e67ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.678342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5dfc-f328-4da4-bae7-3ea558e67ecb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.690491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e5dfc-f328-4da4-bae7-3ea558e67ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-0f7e5dfc-f328-4da4-bae7-3ea558e67ecb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:35.700622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:35.701609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:35.702354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 60/117] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:04:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:35.703817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc66a06-5bb6-4325-ba34-4312ce252eb8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.703912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc66a06-5bb6-4325-ba34-4312ce252eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.704263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc66a06-5bb6-4325-ba34-4312ce252eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.725725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3dc66a06-5bb6-4325-ba34-4312ce252eb8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:35.726831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3dc66a06-5bb6-4325-ba34-4312ce252eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:35.762201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71f117-5341-4404-b6c6-7309b592bd5a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:35.793981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:35.803320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adaf1c-a658-479c-9d55-66f057084eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:35.804054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adaf1c-a658-479c-9d55-66f057084eba None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.804285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adaf1c-a658-479c-9d55-66f057084eba None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.804565 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adaf1c-a658-479c-9d55-66f057084eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.805443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adaf1c-a658-479c-9d55-66f057084eba None admin] RBAC: Adding query filter params (role.id=86fb57959e444c5ba2f9385f06d32865, scope.project.id=b77ea42af6f745e0af87a131f9212231, user.id=56938789392a4d5992c5aab53eb62da1) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:35.805760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adaf1c-a658-479c-9d55-66f057084eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:35.807225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adaf1c-a658-479c-9d55-66f057084eba None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:35.820708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 58/118] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:35 2022] GET /identity/v3/role_assignments?user.id=56938789392a4d5992c5aab53eb62da1&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=86fb57959e444c5ba2f9385f06d32865 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:35.820708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b972bbf-c218-45c2-a431-f84077c6b06a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:35.820708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b972bbf-c218-45c2-a431-f84077c6b06a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:35.820708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b972bbf-c218-45c2-a431-f84077c6b06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:35.827795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 61/119] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:35.828730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc66a06-5bb6-4325-ba34-4312ce252eb8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:35.844180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5b972bbf-c218-45c2-a431-f84077c6b06a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:35.845562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5b972bbf-c218-45c2-a431-f84077c6b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:35.858637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:35.924158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 59/120] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:35.925178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b972bbf-c218-45c2-a431-f84077c6b06a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:35.970717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc66a06-5bb6-4325-ba34-4312ce252eb8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.013552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dec92-c9c9-4abb-bc69-ef92e678fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.015027 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dec92-c9c9-4abb-bc69-ef92e678fdcd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.015707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dec92-c9c9-4abb-bc69-ef92e678fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.016617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dec92-c9c9-4abb-bc69-ef92e678fdcd None admin] PATH_INFO: `/v3/users/ed59d5d85ac94b5e83056380d59a4958` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.018609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dec92-c9c9-4abb-bc69-ef92e678fdcd None admin] RBAC: Authorizing `identity:get_user(user_id=ed59d5d85ac94b5e83056380d59a4958)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:36.021339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dec92-c9c9-4abb-bc69-ef92e678fdcd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:36.024166 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 62/121] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:35 2022] GET /identity/v3/users/ed59d5d85ac94b5e83056380d59a4958 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:36.025175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dec92-c9c9-4abb-bc69-ef92e678fdcd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.074807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b972bbf-c218-45c2-a431-f84077c6b06a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.101099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:36.117079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba6022-97fb-408d-86c0-8b9be9c91bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.118150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba6022-97fb-408d-86c0-8b9be9c91bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.118587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba6022-97fb-408d-86c0-8b9be9c91bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.119087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba6022-97fb-408d-86c0-8b9be9c91bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.120275 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba6022-97fb-408d-86c0-8b9be9c91bf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:36.120780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba6022-97fb-408d-86c0-8b9be9c91bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:36.123398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba6022-97fb-408d-86c0-8b9be9c91bf9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:36.140616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 60/122] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:04:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:36.140616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba6022-97fb-408d-86c0-8b9be9c91bf9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.151448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:36.164791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dec92-c9c9-4abb-bc69-ef92e678fdcd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.202240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80075ab-f198-4f17-85a5-e10b3af3c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.203494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80075ab-f198-4f17-85a5-e10b3af3c8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.204067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80075ab-f198-4f17-85a5-e10b3af3c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.204543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80075ab-f198-4f17-85a5-e10b3af3c8a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.216122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80075ab-f198-4f17-85a5-e10b3af3c8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-f80075ab-f198-4f17-85a5-e10b3af3c8a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:36.225431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:36.226328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:36.227106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:36.229637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 63/123] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:36.230870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80075ab-f198-4f17-85a5-e10b3af3c8a5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.245902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba6022-97fb-408d-86c0-8b9be9c91bf9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.280346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452295d2-123c-4b90-9571-4f3fcfbe3703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.281102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452295d2-123c-4b90-9571-4f3fcfbe3703 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.281387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452295d2-123c-4b90-9571-4f3fcfbe3703 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.281662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452295d2-123c-4b90-9571-4f3fcfbe3703 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.293991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452295d2-123c-4b90-9571-4f3fcfbe3703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-452295d2-123c-4b90-9571-4f3fcfbe3703 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:36.302539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:36.303449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:36.304244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:36.308624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 61/124] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:36.309633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452295d2-123c-4b90-9571-4f3fcfbe3703 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.346066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80075ab-f198-4f17-85a5-e10b3af3c8a5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.365168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:36.384408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b83345-c539-413f-8ce0-703b056703aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.385758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83345-c539-413f-8ce0-703b056703aa None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.386245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83345-c539-413f-8ce0-703b056703aa None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.386721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83345-c539-413f-8ce0-703b056703aa None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.388130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b83345-c539-413f-8ce0-703b056703aa None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:36.388627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:36.391214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b83345-c539-413f-8ce0-703b056703aa None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:36.393566 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 64/125] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:36 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:36.394631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b83345-c539-413f-8ce0-703b056703aa None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.428598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452295d2-123c-4b90-9571-4f3fcfbe3703 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.465610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19477b60-46fa-4980-993b-145f5f70e485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.466529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19477b60-46fa-4980-993b-145f5f70e485 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.466820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19477b60-46fa-4980-993b-145f5f70e485 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.467102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19477b60-46fa-4980-993b-145f5f70e485 None admin] PATH_INFO: `/v3/users/1829e1ee957144f7aae3cc64ec22ab1a` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.468510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19477b60-46fa-4980-993b-145f5f70e485 None admin] RBAC: Authorizing `identity:get_user(user_id=1829e1ee957144f7aae3cc64ec22ab1a)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:36.470152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19477b60-46fa-4980-993b-145f5f70e485 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:36.476600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 62/126] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:36 2022] GET /identity/v3/users/1829e1ee957144f7aae3cc64ec22ab1a => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:36.476600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19477b60-46fa-4980-993b-145f5f70e485 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.522067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b83345-c539-413f-8ce0-703b056703aa None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.559227 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfeb6c-5268-4395-a0b4-28c718e9d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.560331 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfeb6c-5268-4395-a0b4-28c718e9d039 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.560849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfeb6c-5268-4395-a0b4-28c718e9d039 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.561329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfeb6c-5268-4395-a0b4-28c718e9d039 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.562398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfeb6c-5268-4395-a0b4-28c718e9d039 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:36.563054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfeb6c-5268-4395-a0b4-28c718e9d039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:36.564671 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfeb6c-5268-4395-a0b4-28c718e9d039 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:36.574150 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 65/127] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:36.575385 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfeb6c-5268-4395-a0b4-28c718e9d039 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.578334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19477b60-46fa-4980-993b-145f5f70e485 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.619357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0128fe-0222-4b30-8de9-4b14014a1d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.620505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:36.621397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0128fe-0222-4b30-8de9-4b14014a1d6b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.621887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0128fe-0222-4b30-8de9-4b14014a1d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.623068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0128fe-0222-4b30-8de9-4b14014a1d6b None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.624336 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0128fe-0222-4b30-8de9-4b14014a1d6b None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:36.624876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0128fe-0222-4b30-8de9-4b14014a1d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:36.626681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0128fe-0222-4b30-8de9-4b14014a1d6b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:36.629204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:36.640528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 63/128] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:36.641938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0128fe-0222-4b30-8de9-4b14014a1d6b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.685551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfeb6c-5268-4395-a0b4-28c718e9d039 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.720154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc2dac-5cb7-49f1-bb65-a99c7c5a85c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.721280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2dac-5cb7-49f1-bb65-a99c7c5a85c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.721665 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2dac-5cb7-49f1-bb65-a99c7c5a85c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.722037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2dac-5cb7-49f1-bb65-a99c7c5a85c5 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231/users/ed59d5d85ac94b5e83056380d59a4958/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.724334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc2dac-5cb7-49f1-bb65-a99c7c5a85c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ea42af6f745e0af87a131f9212231, user_id=ed59d5d85ac94b5e83056380d59a4958, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:36.725924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc2dac-5cb7-49f1-bb65-a99c7c5a85c5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:36.744539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 66/129] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:04:36 2022] PUT /identity/v3/projects/b77ea42af6f745e0af87a131f9212231/users/ed59d5d85ac94b5e83056380d59a4958/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:04:36.745682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc2dac-5cb7-49f1-bb65-a99c7c5a85c5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.767556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0128fe-0222-4b30-8de9-4b14014a1d6b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.814058 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52486f-2359-441c-bf94-19e4afe9eef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.815289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52486f-2359-441c-bf94-19e4afe9eef1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.815757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52486f-2359-441c-bf94-19e4afe9eef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.816308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52486f-2359-441c-bf94-19e4afe9eef1 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.818285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52486f-2359-441c-bf94-19e4afe9eef1 None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:36.820081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52486f-2359-441c-bf94-19e4afe9eef1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:36.822303 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 64/130] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:36 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:36.827874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52486f-2359-441c-bf94-19e4afe9eef1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.868069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:36.872987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc2dac-5cb7-49f1-bb65-a99c7c5a85c5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:36.904703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:36.919583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfd693-30c1-43a0-ac73-e86c56e812d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:36.920496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfd693-30c1-43a0-ac73-e86c56e812d9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:36.920824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfd693-30c1-43a0-ac73-e86c56e812d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:36.921109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfd693-30c1-43a0-ac73-e86c56e812d9 None admin] PATH_INFO: `/v3/users/1829e1ee957144f7aae3cc64ec22ab1a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:36.922376 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfd693-30c1-43a0-ac73-e86c56e812d9 None admin] RBAC: Authorizing `identity:get_user(user_id=1829e1ee957144f7aae3cc64ec22ab1a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:36.924862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfd693-30c1-43a0-ac73-e86c56e812d9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:36.927666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 67/131] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:36 2022] GET /identity/v3/users/1829e1ee957144f7aae3cc64ec22ab1a => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:36.928814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfd693-30c1-43a0-ac73-e86c56e812d9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:36.958109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52486f-2359-441c-bf94-19e4afe9eef1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:37.004899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a934e8-437e-4229-a434-007ea1b6c4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:37.005816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a934e8-437e-4229-a434-007ea1b6c4de None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:37.006108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a934e8-437e-4229-a434-007ea1b6c4de None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:37.006393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a934e8-437e-4229-a434-007ea1b6c4de None admin] PATH_INFO: `/v3/users/1829e1ee957144f7aae3cc64ec22ab1a` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:37.007684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a934e8-437e-4229-a434-007ea1b6c4de None admin] RBAC: Authorizing `identity:get_user(user_id=1829e1ee957144f7aae3cc64ec22ab1a)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:37.010011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a934e8-437e-4229-a434-007ea1b6c4de None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:37.012290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 65/132] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:36 2022] GET /identity/v3/users/1829e1ee957144f7aae3cc64ec22ab1a => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:37.013285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a934e8-437e-4229-a434-007ea1b6c4de None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:37.050277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfd693-30c1-43a0-ac73-e86c56e812d9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:37.091012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccd0f8-fcf4-4331-a777-1a4d3ab47f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:37.092236 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd0f8-fcf4-4331-a777-1a4d3ab47f2c None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:37.092855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd0f8-fcf4-4331-a777-1a4d3ab47f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:37.093354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd0f8-fcf4-4331-a777-1a4d3ab47f2c None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231/users/1829e1ee957144f7aae3cc64ec22ab1a/roles/45788771d2f1494a801cc09d365ff9e2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:37.095963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccd0f8-fcf4-4331-a777-1a4d3ab47f2c None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ea42af6f745e0af87a131f9212231, user_id=1829e1ee957144f7aae3cc64ec22ab1a, role_id=45788771d2f1494a801cc09d365ff9e2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:37.098099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccd0f8-fcf4-4331-a777-1a4d3ab47f2c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:37.117201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 68/133] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:04:36 2022] PUT /identity/v3/projects/b77ea42af6f745e0af87a131f9212231/users/1829e1ee957144f7aae3cc64ec22ab1a/roles/45788771d2f1494a801cc09d365ff9e2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:04:37.118428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccd0f8-fcf4-4331-a777-1a4d3ab47f2c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:37.138151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a934e8-437e-4229-a434-007ea1b6c4de None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:37.162142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:37.175636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:37.184836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d10a4-6f4b-4293-999d-c16a6c594cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:37.186159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d10a4-6f4b-4293-999d-c16a6c594cec None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:37.186691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d10a4-6f4b-4293-999d-c16a6c594cec None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:37.187164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d10a4-6f4b-4293-999d-c16a6c594cec None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:37.188704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d10a4-6f4b-4293-999d-c16a6c594cec None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:37.190440 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d10a4-6f4b-4293-999d-c16a6c594cec None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:37.193857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 66/134] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:37 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:37.201771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d10a4-6f4b-4293-999d-c16a6c594cec None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:37.329506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccd0f8-fcf4-4331-a777-1a4d3ab47f2c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:37.370153 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d10a4-6f4b-4293-999d-c16a6c594cec None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:37.401840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cbd4c-d060-40c1-8238-25cb37b7ecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:37.402744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cbd4c-d060-40c1-8238-25cb37b7ecf4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:37.403029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cbd4c-d060-40c1-8238-25cb37b7ecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:37.404470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cbd4c-d060-40c1-8238-25cb37b7ecf4 None admin] PATH_INFO: `/v3/projects/c17fb68ad7db4a01a655588cdbabf576` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:37.411481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cbd4c-d060-40c1-8238-25cb37b7ecf4 None admin] RBAC: Authorizing `identity:get_project(project_id=c17fb68ad7db4a01a655588cdbabf576)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:37.412992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cbd4c-d060-40c1-8238-25cb37b7ecf4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:37.415968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 69/135] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:37 2022] GET /identity/v3/projects/c17fb68ad7db4a01a655588cdbabf576 => generated 312 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:37.423861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cbd4c-d060-40c1-8238-25cb37b7ecf4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:37.444751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344df5b-e19b-40ff-b15b-3274220ed527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:37.446074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344df5b-e19b-40ff-b15b-3274220ed527 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:37.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344df5b-e19b-40ff-b15b-3274220ed527 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:37.447087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344df5b-e19b-40ff-b15b-3274220ed527 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231/users/1829e1ee957144f7aae3cc64ec22ab1a/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:37.454103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344df5b-e19b-40ff-b15b-3274220ed527 None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ea42af6f745e0af87a131f9212231, user_id=1829e1ee957144f7aae3cc64ec22ab1a, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:37.455842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344df5b-e19b-40ff-b15b-3274220ed527 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:37.485796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 67/136] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:04:37 2022] PUT /identity/v3/projects/b77ea42af6f745e0af87a131f9212231/users/1829e1ee957144f7aae3cc64ec22ab1a/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:04:37.539681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:37.547392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cbd4c-d060-40c1-8238-25cb37b7ecf4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:37.587503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538ebb-0543-41bb-8a3d-bca7c1841869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:37.588416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538ebb-0543-41bb-8a3d-bca7c1841869 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:37.588728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538ebb-0543-41bb-8a3d-bca7c1841869 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:37.589013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538ebb-0543-41bb-8a3d-bca7c1841869 None admin] PATH_INFO: `/v3/projects/c17fb68ad7db4a01a655588cdbabf576/users/1829e1ee957144f7aae3cc64ec22ab1a/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:37.591214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538ebb-0543-41bb-8a3d-bca7c1841869 None admin] RBAC: Authorizing `identity:create_grant(project_id=c17fb68ad7db4a01a655588cdbabf576, user_id=1829e1ee957144f7aae3cc64ec22ab1a, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:37.592745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538ebb-0543-41bb-8a3d-bca7c1841869 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:37.612565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 70/137] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:04:37 2022] PUT /identity/v3/projects/c17fb68ad7db4a01a655588cdbabf576/users/1829e1ee957144f7aae3cc64ec22ab1a/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:04:37.800867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d46d0-6734-4a48-96ee-c7e7e73564fd None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:37.801569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d46d0-6734-4a48-96ee-c7e7e73564fd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:37.802132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d46d0-6734-4a48-96ee-c7e7e73564fd None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:37.803794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 68/138] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:37.811219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dab35-0738-4a4e-96a9-6fca8ad66f82 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:37.811513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dab35-0738-4a4e-96a9-6fca8ad66f82 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:37.811840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dab35-0738-4a4e-96a9-6fca8ad66f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:37.835139 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-048dab35-0738-4a4e-96a9-6fca8ad66f82 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:37.836378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-048dab35-0738-4a4e-96a9-6fca8ad66f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:37.913493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 71/139] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:37.938631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d46d0-6734-4a48-96ee-c7e7e73564fd None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:38.005166 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:38.052375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d46d0-6734-4a48-96ee-c7e7e73564fd None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:38.086907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654630c-0347-4822-b6f4-f750764f8643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:38.087724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654630c-0347-4822-b6f4-f750764f8643 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:38.088010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654630c-0347-4822-b6f4-f750764f8643 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:38.088290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654630c-0347-4822-b6f4-f750764f8643 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:38.089561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654630c-0347-4822-b6f4-f750764f8643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:38.091056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654630c-0347-4822-b6f4-f750764f8643 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:38.092710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 69/140] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:38.099885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dab35-0738-4a4e-96a9-6fca8ad66f82 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:38.188455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:38.205108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dab35-0738-4a4e-96a9-6fca8ad66f82 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:38.242264 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b1c1b-c3f3-40c7-a8c7-12cd25ba7eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:38.242953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b1c1b-c3f3-40c7-a8c7-12cd25ba7eaa None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:38.243234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b1c1b-c3f3-40c7-a8c7-12cd25ba7eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:38.243508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b1c1b-c3f3-40c7-a8c7-12cd25ba7eaa None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:38.244232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b1c1b-c3f3-40c7-a8c7-12cd25ba7eaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:38.245714 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b1c1b-c3f3-40c7-a8c7-12cd25ba7eaa None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:38.272285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 72/141] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:04:38 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:04:38.357074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe22ad-3a31-4c42-9ab4-ec39668ca9c1 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:38.357560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe22ad-3a31-4c42-9ab4-ec39668ca9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:38.357560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe22ad-3a31-4c42-9ab4-ec39668ca9c1 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:38.359007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 70/142] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:38.365688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428e67f-84c3-48f5-bf26-4f7ea0b44ba5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:38.365996 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428e67f-84c3-48f5-bf26-4f7ea0b44ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:38.366247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428e67f-84c3-48f5-bf26-4f7ea0b44ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:38.385499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e428e67f-84c3-48f5-bf26-4f7ea0b44ba5 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:38.386742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e428e67f-84c3-48f5-bf26-4f7ea0b44ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:38.470025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 73/143] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:38.516167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe22ad-3a31-4c42-9ab4-ec39668ca9c1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:38.653937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe22ad-3a31-4c42-9ab4-ec39668ca9c1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:38.682685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:38.691853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb900aeb-5ef4-4169-af7a-defdfdbe472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:38.692717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb900aeb-5ef4-4169-af7a-defdfdbe472c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:38.693903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb900aeb-5ef4-4169-af7a-defdfdbe472c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:38.694188 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb900aeb-5ef4-4169-af7a-defdfdbe472c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:38.705998 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb900aeb-5ef4-4169-af7a-defdfdbe472c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-fb900aeb-5ef4-4169-af7a-defdfdbe472c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:38.713890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:38.714865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:38.715680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 71/144] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:38.725802 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428e67f-84c3-48f5-bf26-4f7ea0b44ba5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:38.826100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:38.863476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428e67f-84c3-48f5-bf26-4f7ea0b44ba5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:38.900304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59605c-4150-48d3-9c45-a1879bcfc40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:38.901020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59605c-4150-48d3-9c45-a1879bcfc40d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:38.901306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59605c-4150-48d3-9c45-a1879bcfc40d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:38.901565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59605c-4150-48d3-9c45-a1879bcfc40d None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:38.902337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59605c-4150-48d3-9c45-a1879bcfc40d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:38.902643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59605c-4150-48d3-9c45-a1879bcfc40d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:38.904085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59605c-4150-48d3-9c45-a1879bcfc40d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:38.913706 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 74/145] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:38.919662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb900aeb-5ef4-4169-af7a-defdfdbe472c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:39.047030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb900aeb-5ef4-4169-af7a-defdfdbe472c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:39.092838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503d9e3-4845-4dcc-abf4-22cae1c1e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:39.093759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503d9e3-4845-4dcc-abf4-22cae1c1e5ec None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:39.094031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503d9e3-4845-4dcc-abf4-22cae1c1e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:39.094297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503d9e3-4845-4dcc-abf4-22cae1c1e5ec None admin] PATH_INFO: `/v3/users/56938789392a4d5992c5aab53eb62da1` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:39.095509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503d9e3-4845-4dcc-abf4-22cae1c1e5ec None admin] RBAC: Authorizing `identity:get_user(user_id=56938789392a4d5992c5aab53eb62da1)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:39.097607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503d9e3-4845-4dcc-abf4-22cae1c1e5ec None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:39.099271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 72/146] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:38 2022] GET /identity/v3/users/56938789392a4d5992c5aab53eb62da1 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:39.104941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59605c-4150-48d3-9c45-a1879bcfc40d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:39.227464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59605c-4150-48d3-9c45-a1879bcfc40d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:39.259158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:39.265926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b80da-a5d1-450e-82d6-98695ba93527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:39.266801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b80da-a5d1-450e-82d6-98695ba93527 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:39.267082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b80da-a5d1-450e-82d6-98695ba93527 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:39.267357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b80da-a5d1-450e-82d6-98695ba93527 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:39.268609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b80da-a5d1-450e-82d6-98695ba93527 None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:39.270758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b80da-a5d1-450e-82d6-98695ba93527 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:39.272493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 75/147] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:39 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:39.278270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503d9e3-4845-4dcc-abf4-22cae1c1e5ec None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:39.341724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:39.400227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503d9e3-4845-4dcc-abf4-22cae1c1e5ec None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:39.443703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3deb7-4b22-4676-9aca-55592f473e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:39.446383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3deb7-4b22-4676-9aca-55592f473e0b None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:39.446730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3deb7-4b22-4676-9aca-55592f473e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:39.447021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3deb7-4b22-4676-9aca-55592f473e0b None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231/users/56938789392a4d5992c5aab53eb62da1/roles/86fb57959e444c5ba2f9385f06d32865` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:39.449270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3deb7-4b22-4676-9aca-55592f473e0b None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ea42af6f745e0af87a131f9212231, user_id=56938789392a4d5992c5aab53eb62da1, role_id=86fb57959e444c5ba2f9385f06d32865)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:39.450835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3deb7-4b22-4676-9aca-55592f473e0b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:39.478663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 73/148] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:04:39 2022] PUT /identity/v3/projects/b77ea42af6f745e0af87a131f9212231/users/56938789392a4d5992c5aab53eb62da1/roles/86fb57959e444c5ba2f9385f06d32865 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:04:40.337450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c787-2e68-4f92-8ee6-aa564e6460d7 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:40.338009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c787-2e68-4f92-8ee6-aa564e6460d7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:40.338009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c787-2e68-4f92-8ee6-aa564e6460d7 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:40.339390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 76/149] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:40.345001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc87e4-8740-409d-ba6b-a5eb9dc4e37d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:40.345292 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc87e4-8740-409d-ba6b-a5eb9dc4e37d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:40.345569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc87e4-8740-409d-ba6b-a5eb9dc4e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:40.369787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0cfc87e4-8740-409d-ba6b-a5eb9dc4e37d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:40.371007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0cfc87e4-8740-409d-ba6b-a5eb9dc4e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:40.398445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc8be2-7bdb-4b5b-8778-ebc1d643db30 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:40.398776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc8be2-7bdb-4b5b-8778-ebc1d643db30 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:40.399012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc8be2-7bdb-4b5b-8778-ebc1d643db30 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:40.400536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 77/150] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:04:40.405558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777643dd-da42-4672-bd53-8cb1fbf75ee3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:40.405843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777643dd-da42-4672-bd53-8cb1fbf75ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:40.406118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777643dd-da42-4672-bd53-8cb1fbf75ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:40.431956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-777643dd-da42-4672-bd53-8cb1fbf75ee3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:40.442331 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-777643dd-da42-4672-bd53-8cb1fbf75ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:40.505504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 74/151] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:40.539896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc87e4-8740-409d-ba6b-a5eb9dc4e37d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:40.571844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 78/152] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:40.603731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:40.612634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777643dd-da42-4672-bd53-8cb1fbf75ee3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:40.739392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777643dd-da42-4672-bd53-8cb1fbf75ee3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:40.751560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc87e4-8740-409d-ba6b-a5eb9dc4e37d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:40.772528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:40.780333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276717b3-938f-49be-8c5f-c42f9a877971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:40.781336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276717b3-938f-49be-8c5f-c42f9a877971 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:40.781621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276717b3-938f-49be-8c5f-c42f9a877971 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:40.781892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276717b3-938f-49be-8c5f-c42f9a877971 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:40.798749 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133fecf-d9e4-4040-9d9d-ef8a9d312a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:40.798975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276717b3-938f-49be-8c5f-c42f9a877971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:40.799617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133fecf-d9e4-4040-9d9d-ef8a9d312a59 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:40.799923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133fecf-d9e4-4040-9d9d-ef8a9d312a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:40.800195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133fecf-d9e4-4040-9d9d-ef8a9d312a59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:40.810880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133fecf-d9e4-4040-9d9d-ef8a9d312a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-276717b3-938f-49be-8c5f-c42f9a877971 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:40.811497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:40.812329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:40.813136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 79/153] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:04:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-c133fecf-d9e4-4040-9d9d-ef8a9d312a59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:40.818632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:40.820739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:40.822614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 75/154] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:04:40.833734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133fecf-d9e4-4040-9d9d-ef8a9d312a59 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:40.833980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276717b3-938f-49be-8c5f-c42f9a877971 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:40.978621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276717b3-938f-49be-8c5f-c42f9a877971 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:40.991405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133fecf-d9e4-4040-9d9d-ef8a9d312a59 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:40.998709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:41.031364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e919c45-f500-4efd-83b2-60936b8e87dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:41.032134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e919c45-f500-4efd-83b2-60936b8e87dc None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.032419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e919c45-f500-4efd-83b2-60936b8e87dc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.032717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e919c45-f500-4efd-83b2-60936b8e87dc None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.033485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e919c45-f500-4efd-83b2-60936b8e87dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:41.033838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e919c45-f500-4efd-83b2-60936b8e87dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:41.035241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e919c45-f500-4efd-83b2-60936b8e87dc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:41.047823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 80/155] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:04:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:41.049430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0102aa-ecb7-4d36-be50-b34793b7f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:41.050435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0102aa-ecb7-4d36-be50-b34793b7f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.050725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0102aa-ecb7-4d36-be50-b34793b7f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.051000 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0102aa-ecb7-4d36-be50-b34793b7f4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.051772 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0102aa-ecb7-4d36-be50-b34793b7f4d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:41.052079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0102aa-ecb7-4d36-be50-b34793b7f4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:41.053503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0102aa-ecb7-4d36-be50-b34793b7f4d6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:41.055395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e919c45-f500-4efd-83b2-60936b8e87dc None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:41.062719 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 76/156] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:41.068701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0102aa-ecb7-4d36-be50-b34793b7f4d6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:41.132822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:41.199426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e919c45-f500-4efd-83b2-60936b8e87dc None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:41.214484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0102aa-ecb7-4d36-be50-b34793b7f4d6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:41.235642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3849a-14c7-4d9a-b714-598cc3bc5c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:41.236545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3849a-14c7-4d9a-b714-598cc3bc5c5e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.236884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3849a-14c7-4d9a-b714-598cc3bc5c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.237142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3849a-14c7-4d9a-b714-598cc3bc5c5e None admin] PATH_INFO: `/v3/users/1829e1ee957144f7aae3cc64ec22ab1a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.242335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3849a-14c7-4d9a-b714-598cc3bc5c5e None admin] RBAC: Authorizing `identity:get_user(user_id=1829e1ee957144f7aae3cc64ec22ab1a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:41.245529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3849a-14c7-4d9a-b714-598cc3bc5c5e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:41.247807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 81/157] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:41 2022] GET /identity/v3/users/1829e1ee957144f7aae3cc64ec22ab1a => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:41.253449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3849a-14c7-4d9a-b714-598cc3bc5c5e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:41.275372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93385a-56f7-4a64-97ef-d4da57c5fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:41.276267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93385a-56f7-4a64-97ef-d4da57c5fe0e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.276548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93385a-56f7-4a64-97ef-d4da57c5fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.277229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93385a-56f7-4a64-97ef-d4da57c5fe0e None admin] PATH_INFO: `/v3/users/ed59d5d85ac94b5e83056380d59a4958` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.278506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93385a-56f7-4a64-97ef-d4da57c5fe0e None admin] RBAC: Authorizing `identity:get_user(user_id=ed59d5d85ac94b5e83056380d59a4958)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:41.279959 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93385a-56f7-4a64-97ef-d4da57c5fe0e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:41.281952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 77/158] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:41 2022] GET /identity/v3/users/ed59d5d85ac94b5e83056380d59a4958 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:41.291355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93385a-56f7-4a64-97ef-d4da57c5fe0e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:41.348053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:41.424157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93385a-56f7-4a64-97ef-d4da57c5fe0e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:41.489671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591aa7e0-d2e6-485e-826c-0e06a0e476b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:41.491408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aa7e0-d2e6-485e-826c-0e06a0e476b1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.493060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aa7e0-d2e6-485e-826c-0e06a0e476b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.493704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aa7e0-d2e6-485e-826c-0e06a0e476b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.501892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3849a-14c7-4d9a-b714-598cc3bc5c5e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:41.539146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:41.556689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f939f63-965f-430e-9bd7-2154088bab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:41.557569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f939f63-965f-430e-9bd7-2154088bab13 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.557989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f939f63-965f-430e-9bd7-2154088bab13 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.558420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f939f63-965f-430e-9bd7-2154088bab13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.610320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aa7e0-d2e6-485e-826c-0e06a0e476b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:41.611839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aa7e0-d2e6-485e-826c-0e06a0e476b1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:41.631613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f939f63-965f-430e-9bd7-2154088bab13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:41.633342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f939f63-965f-430e-9bd7-2154088bab13 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:41.685689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:41.742670 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 82/159] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:41.744336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64789635-cc5d-4f38-a895-199ec9443df4 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.744781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64789635-cc5d-4f38-a895-199ec9443df4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.745575 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64789635-cc5d-4f38-a895-199ec9443df4 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.747062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 83/160] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:41.748399 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f49a4-7cad-480b-aeb4-f7e2364a778c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.748837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f49a4-7cad-480b-aeb4-f7e2364a778c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.749291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f49a4-7cad-480b-aeb4-f7e2364a778c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.750683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 84/161] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:41.752986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426d4ed-bc2b-486e-9a44-3fc4a09a6ad2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.753686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426d4ed-bc2b-486e-9a44-3fc4a09a6ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.754168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426d4ed-bc2b-486e-9a44-3fc4a09a6ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.771571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6426d4ed-bc2b-486e-9a44-3fc4a09a6ad2 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:41.773067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6426d4ed-bc2b-486e-9a44-3fc4a09a6ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:41.788755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:41.849875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 85/162] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:41.851238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426d4ed-bc2b-486e-9a44-3fc4a09a6ad2 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:41.876213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 78/163] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:41.877661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a579523-db5d-4575-9f9e-34e3872a085a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.877964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a579523-db5d-4575-9f9e-34e3872a085a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.878324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a579523-db5d-4575-9f9e-34e3872a085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.908942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0a579523-db5d-4575-9f9e-34e3872a085a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:41.910304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0a579523-db5d-4575-9f9e-34e3872a085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:41.959560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426d4ed-bc2b-486e-9a44-3fc4a09a6ad2 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:41.995633 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bf661-2912-4cf2-b094-c4a577ba173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:41.996863 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bf661-2912-4cf2-b094-c4a577ba173d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:41.997428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bf661-2912-4cf2-b094-c4a577ba173d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:41.998025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bf661-2912-4cf2-b094-c4a577ba173d None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:41.999364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bf661-2912-4cf2-b094-c4a577ba173d None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:42.001035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bf661-2912-4cf2-b094-c4a577ba173d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:42.003190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 86/164] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:41 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:42.004273 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bf661-2912-4cf2-b094-c4a577ba173d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:42.024224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:42.075293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 79/165] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:42.076174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a579523-db5d-4575-9f9e-34e3872a085a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:42.115777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bf661-2912-4cf2-b094-c4a577ba173d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:42.154304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f9dad-9bf3-4707-865c-3a12c0f7019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:42.155573 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9dad-9bf3-4707-865c-3a12c0f7019f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:42.156189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9dad-9bf3-4707-865c-3a12c0f7019f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:42.156631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9dad-9bf3-4707-865c-3a12c0f7019f None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:42.158081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f9dad-9bf3-4707-865c-3a12c0f7019f None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:42.159930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f9dad-9bf3-4707-865c-3a12c0f7019f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:42.162033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 87/166] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:42 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:42.163095 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f9dad-9bf3-4707-865c-3a12c0f7019f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:42.191718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:42.247448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a579523-db5d-4575-9f9e-34e3872a085a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:42.262662 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:42.281233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f9dad-9bf3-4707-865c-3a12c0f7019f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:42.313921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b88f90-ca94-4621-b34e-11f0fe02334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:42.314789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88f90-ca94-4621-b34e-11f0fe02334d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:42.315171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88f90-ca94-4621-b34e-11f0fe02334d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:42.315447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88f90-ca94-4621-b34e-11f0fe02334d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:42.319826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66829c-c0e1-4c05-b12e-e47082eec0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:42.320729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66829c-c0e1-4c05-b12e-e47082eec0ce None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:42.321245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66829c-c0e1-4c05-b12e-e47082eec0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:42.321704 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66829c-c0e1-4c05-b12e-e47082eec0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:42.322884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66829c-c0e1-4c05-b12e-e47082eec0ce None admin] RBAC: Adding query filter params (role.id=45788771d2f1494a801cc09d365ff9e2, scope.project.id=b77ea42af6f745e0af87a131f9212231, user.id=1829e1ee957144f7aae3cc64ec22ab1a) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:42.323447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66829c-c0e1-4c05-b12e-e47082eec0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:42.325160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66829c-c0e1-4c05-b12e-e47082eec0ce None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:42.331968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 88/167] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:42 2022] GET /identity/v3/role_assignments?user.id=1829e1ee957144f7aae3cc64ec22ab1a&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=45788771d2f1494a801cc09d365ff9e2 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:42.333266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66829c-c0e1-4c05-b12e-e47082eec0ce None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:42.337935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b88f90-ca94-4621-b34e-11f0fe02334d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-47b88f90-ca94-4621-b34e-11f0fe02334d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:42.353679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:42.354868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 80/168] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:42.355900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b88f90-ca94-4621-b34e-11f0fe02334d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:42.452931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66829c-c0e1-4c05-b12e-e47082eec0ce None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:42.492532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12d742-cde6-4c42-aa62-0be9fb5cfe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:42.493733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12d742-cde6-4c42-aa62-0be9fb5cfe47 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:42.494217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12d742-cde6-4c42-aa62-0be9fb5cfe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:42.494712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12d742-cde6-4c42-aa62-0be9fb5cfe47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:42.508225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12d742-cde6-4c42-aa62-0be9fb5cfe47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-6b12d742-cde6-4c42-aa62-0be9fb5cfe47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:42.517101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:42.518011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:42.518803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:42.521345 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 89/169] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:42.521632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b88f90-ca94-4621-b34e-11f0fe02334d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:42.522826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12d742-cde6-4c42-aa62-0be9fb5cfe47 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:42.538339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:42.566109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:42.582611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf0f2c-e585-4e03-bfbc-bfa72c116f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:42.583285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf0f2c-e585-4e03-bfbc-bfa72c116f27 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:42.583567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf0f2c-e585-4e03-bfbc-bfa72c116f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:42.583838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf0f2c-e585-4e03-bfbc-bfa72c116f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:42.584699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf0f2c-e585-4e03-bfbc-bfa72c116f27 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=b77ea42af6f745e0af87a131f9212231, user.id=ed59d5d85ac94b5e83056380d59a4958) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:42.585008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf0f2c-e585-4e03-bfbc-bfa72c116f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:42.586457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf0f2c-e585-4e03-bfbc-bfa72c116f27 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:42.601027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 81/170] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:42 2022] GET /identity/v3/role_assignments?user.id=ed59d5d85ac94b5e83056380d59a4958&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:42.601853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf0f2c-e585-4e03-bfbc-bfa72c116f27 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:42.647379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12d742-cde6-4c42-aa62-0be9fb5cfe47 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:42.687456 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba270f8-d7d8-4fb8-9000-cef1c8e93f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:42.688543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba270f8-d7d8-4fb8-9000-cef1c8e93f08 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:42.689073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba270f8-d7d8-4fb8-9000-cef1c8e93f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:42.689543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba270f8-d7d8-4fb8-9000-cef1c8e93f08 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:42.690711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba270f8-d7d8-4fb8-9000-cef1c8e93f08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:42.691358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba270f8-d7d8-4fb8-9000-cef1c8e93f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:42.693035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba270f8-d7d8-4fb8-9000-cef1c8e93f08 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:42.703213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 90/171] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:42.708880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba270f8-d7d8-4fb8-9000-cef1c8e93f08 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:42.746736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf0f2c-e585-4e03-bfbc-bfa72c116f27 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:42.803772 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:42.825384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0efe02-2bdb-44d9-918e-9ca397090b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:42.826085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0efe02-2bdb-44d9-918e-9ca397090b4b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:42.826371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0efe02-2bdb-44d9-918e-9ca397090b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:42.826644 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0efe02-2bdb-44d9-918e-9ca397090b4b None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:42.827624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0efe02-2bdb-44d9-918e-9ca397090b4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:42.827732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0efe02-2bdb-44d9-918e-9ca397090b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:42.829469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0efe02-2bdb-44d9-918e-9ca397090b4b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:42.846701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba270f8-d7d8-4fb8-9000-cef1c8e93f08 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:42.850666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 82/172] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:42.861796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0efe02-2bdb-44d9-918e-9ca397090b4b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:42.901690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f783e-0dd1-4b35-91c2-2b8aeae0d888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:42.903082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f783e-0dd1-4b35-91c2-2b8aeae0d888 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:42.903565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f783e-0dd1-4b35-91c2-2b8aeae0d888 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:42.904047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f783e-0dd1-4b35-91c2-2b8aeae0d888 None admin] PATH_INFO: `/v3/users/1829e1ee957144f7aae3cc64ec22ab1a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:42.907262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f783e-0dd1-4b35-91c2-2b8aeae0d888 None admin] RBAC: Authorizing `identity:get_user(user_id=1829e1ee957144f7aae3cc64ec22ab1a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:42.909211 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f783e-0dd1-4b35-91c2-2b8aeae0d888 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:42.911211 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 91/173] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:42 2022] GET /identity/v3/users/1829e1ee957144f7aae3cc64ec22ab1a => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:42.917422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f783e-0dd1-4b35-91c2-2b8aeae0d888 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:43.017103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:43.047600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f783e-0dd1-4b35-91c2-2b8aeae0d888 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:43.085453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf9254-f9ea-44ac-8157-39f0de214484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:43.086469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf9254-f9ea-44ac-8157-39f0de214484 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.086942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf9254-f9ea-44ac-8157-39f0de214484 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.087401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf9254-f9ea-44ac-8157-39f0de214484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.100022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:43.129567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0efe02-2bdb-44d9-918e-9ca397090b4b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:43.175434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf9254-f9ea-44ac-8157-39f0de214484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:43.175943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec1ad0-fd90-42c1-9266-9c62f395e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:43.176890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1ad0-fd90-42c1-9266-9c62f395e7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.177174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1ad0-fd90-42c1-9266-9c62f395e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.177444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1ad0-fd90-42c1-9266-9c62f395e7e4 None admin] PATH_INFO: `/v3/users/1829e1ee957144f7aae3cc64ec22ab1a` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.178303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf9254-f9ea-44ac-8157-39f0de214484 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:43.178660 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec1ad0-fd90-42c1-9266-9c62f395e7e4 None admin] RBAC: Authorizing `identity:get_user(user_id=1829e1ee957144f7aae3cc64ec22ab1a)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:43.180074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec1ad0-fd90-42c1-9266-9c62f395e7e4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:43.182968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 83/174] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:42 2022] GET /identity/v3/users/1829e1ee957144f7aae3cc64ec22ab1a => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:43.184174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a8c2-ebd8-44be-9100-8fc90e35cb5a None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.184460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a8c2-ebd8-44be-9100-8fc90e35cb5a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.184757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a8c2-ebd8-44be-9100-8fc90e35cb5a None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.185989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 84/175] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:43.187059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83b957-a63c-4095-bdf6-643e07427900 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.187340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83b957-a63c-4095-bdf6-643e07427900 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.187613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83b957-a63c-4095-bdf6-643e07427900 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.192908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 85/176] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:43.196450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039b20-0953-405e-be39-01fc3b74edaa None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.196886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039b20-0953-405e-be39-01fc3b74edaa None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.197119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039b20-0953-405e-be39-01fc3b74edaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.220128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-11039b20-0953-405e-be39-01fc3b74edaa None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:43.222578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-11039b20-0953-405e-be39-01fc3b74edaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:43.310586 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 86/177] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:43.310771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11039b20-0953-405e-be39-01fc3b74edaa None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:43.314562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 92/178] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:04:43.316185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce272c61-7e48-44db-96fd-32121b35c885 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.316711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce272c61-7e48-44db-96fd-32121b35c885 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.317192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce272c61-7e48-44db-96fd-32121b35c885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.334322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ce272c61-7e48-44db-96fd-32121b35c885 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:43.335883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ce272c61-7e48-44db-96fd-32121b35c885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:43.372646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:43.382565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:43.420923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 93/179] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:43.422395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce272c61-7e48-44db-96fd-32121b35c885 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:43.439104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11039b20-0953-405e-be39-01fc3b74edaa None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:43.484074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbc7cd-0edd-4285-aa7d-2666a94ef09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:43.484767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbc7cd-0edd-4285-aa7d-2666a94ef09c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.485051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbc7cd-0edd-4285-aa7d-2666a94ef09c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.485325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbc7cd-0edd-4285-aa7d-2666a94ef09c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.533040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce272c61-7e48-44db-96fd-32121b35c885 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:43.571408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01a584-2404-4a1d-b96e-26cb320e4df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:43.572652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01a584-2404-4a1d-b96e-26cb320e4df8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.573191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01a584-2404-4a1d-b96e-26cb320e4df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.573666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01a584-2404-4a1d-b96e-26cb320e4df8 None admin] PATH_INFO: `/v3/projects/c17fb68ad7db4a01a655588cdbabf576` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.575076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01a584-2404-4a1d-b96e-26cb320e4df8 None admin] RBAC: Authorizing `identity:get_project(project_id=c17fb68ad7db4a01a655588cdbabf576)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:43.576723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01a584-2404-4a1d-b96e-26cb320e4df8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:43.577061 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbc7cd-0edd-4285-aa7d-2666a94ef09c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:43.578525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbc7cd-0edd-4285-aa7d-2666a94ef09c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:43.579119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 94/180] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:43 2022] GET /identity/v3/projects/c17fb68ad7db4a01a655588cdbabf576 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:43.580266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01a584-2404-4a1d-b96e-26cb320e4df8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:43.627464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:43.643962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:43.698800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 87/181] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:43.699656 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbc7cd-0edd-4285-aa7d-2666a94ef09c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:43.700937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01a584-2404-4a1d-b96e-26cb320e4df8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:43.738015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae33b0-403f-42de-a18b-9f2d73c523a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:43.738844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae33b0-403f-42de-a18b-9f2d73c523a5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.739127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae33b0-403f-42de-a18b-9f2d73c523a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.739403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae33b0-403f-42de-a18b-9f2d73c523a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.750690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae33b0-403f-42de-a18b-9f2d73c523a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c0ae33b0-403f-42de-a18b-9f2d73c523a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:43.759397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:43.760292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:43.761202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 95/182] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:04:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:43.765790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae33b0-403f-42de-a18b-9f2d73c523a5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:43.807578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbc7cd-0edd-4285-aa7d-2666a94ef09c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:43.842659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6a2e2-9793-4b8a-bc2e-6f52189146ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:43.844018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6a2e2-9793-4b8a-bc2e-6f52189146ce None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.844527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6a2e2-9793-4b8a-bc2e-6f52189146ce None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.845075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6a2e2-9793-4b8a-bc2e-6f52189146ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.858874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6a2e2-9793-4b8a-bc2e-6f52189146ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:43.866905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-80a6a2e2-9793-4b8a-bc2e-6f52189146ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:43.867183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:43.868373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:43.869379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 88/183] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:04:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:43.870037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f755-1abc-4861-8ef6-883f82a5c7e8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.870037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f755-1abc-4861-8ef6-883f82a5c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.870162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f755-1abc-4861-8ef6-883f82a5c7e8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.871418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 89/184] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:43.872976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706f755-1abc-4861-8ef6-883f82a5c7e8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:43.876466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae33b0-403f-42de-a18b-9f2d73c523a5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:43.886541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:43.911947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03464a-0e16-4f20-b373-8d9d50388b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:43.912591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03464a-0e16-4f20-b373-8d9d50388b10 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:43.912922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03464a-0e16-4f20-b373-8d9d50388b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:43.913199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03464a-0e16-4f20-b373-8d9d50388b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:43.914031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03464a-0e16-4f20-b373-8d9d50388b10 None admin] RBAC: Adding query filter params (role.id=1790dd5eeda1419ca41830c6448c63fe, scope.project.id=c17fb68ad7db4a01a655588cdbabf576, user.id=1829e1ee957144f7aae3cc64ec22ab1a) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:43.914338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03464a-0e16-4f20-b373-8d9d50388b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:43.915791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03464a-0e16-4f20-b373-8d9d50388b10 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:43.921586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 96/185] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:43 2022] GET /identity/v3/role_assignments?user.id=1829e1ee957144f7aae3cc64ec22ab1a&scope.project.id=c17fb68ad7db4a01a655588cdbabf576&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:43.922781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03464a-0e16-4f20-b373-8d9d50388b10 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:43.994209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706f755-1abc-4861-8ef6-883f82a5c7e8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:44.032170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989fe88-fcfe-47a1-a9af-5ab0306d60ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:44.033658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989fe88-fcfe-47a1-a9af-5ab0306d60ac None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.033939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989fe88-fcfe-47a1-a9af-5ab0306d60ac None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.034386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989fe88-fcfe-47a1-a9af-5ab0306d60ac None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.035713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989fe88-fcfe-47a1-a9af-5ab0306d60ac None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:44.037214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989fe88-fcfe-47a1-a9af-5ab0306d60ac None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:44.043931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 90/186] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:43 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:44.043931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51b829-bc2a-4729-b9f1-c3baeb77d349 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.043931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51b829-bc2a-4729-b9f1-c3baeb77d349 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.043931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51b829-bc2a-4729-b9f1-c3baeb77d349 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.043931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 91/187] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:44.043931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51b829-bc2a-4729-b9f1-c3baeb77d349 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:44.054751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03464a-0e16-4f20-b373-8d9d50388b10 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:44.094142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596643e-b0eb-4b24-b4ce-60b289faa0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:44.094697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596643e-b0eb-4b24-b4ce-60b289faa0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.095257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596643e-b0eb-4b24-b4ce-60b289faa0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.095257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596643e-b0eb-4b24-b4ce-60b289faa0d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.096067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596643e-b0eb-4b24-b4ce-60b289faa0d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:44.096724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596643e-b0eb-4b24-b4ce-60b289faa0d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:44.097792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596643e-b0eb-4b24-b4ce-60b289faa0d6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:44.114556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 97/188] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:04:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:44.114556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b2c8f-40be-42b9-ba16-b9573c804941 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.114556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b2c8f-40be-42b9-ba16-b9573c804941 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.114556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b2c8f-40be-42b9-ba16-b9573c804941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.129313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-eb6b2c8f-40be-42b9-ba16-b9573c804941 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:44.130524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-eb6b2c8f-40be-42b9-ba16-b9573c804941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:44.141418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:44.150508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:44.165332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51b829-bc2a-4729-b9f1-c3baeb77d349 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:44.198436 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42f39c-90e9-415c-b690-3a2865dbbf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:44.199094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f39c-90e9-415c-b690-3a2865dbbf75 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.199224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 98/189] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:44.200055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b2c8f-40be-42b9-ba16-b9573c804941 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:44.205054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f39c-90e9-415c-b690-3a2865dbbf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.205354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f39c-90e9-415c-b690-3a2865dbbf75 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.206143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42f39c-90e9-415c-b690-3a2865dbbf75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:44.206484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42f39c-90e9-415c-b690-3a2865dbbf75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:44.207872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42f39c-90e9-415c-b690-3a2865dbbf75 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:44.216524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 92/190] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:44.217588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de288-8c9b-433b-93e1-590504ad90dc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.217871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de288-8c9b-433b-93e1-590504ad90dc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.218146 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de288-8c9b-433b-93e1-590504ad90dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.234640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8b6de288-8c9b-433b-93e1-590504ad90dc None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:44.235821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8b6de288-8c9b-433b-93e1-590504ad90dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:44.303412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 93/191] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:44.304305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6de288-8c9b-433b-93e1-590504ad90dc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:44.316205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b2c8f-40be-42b9-ba16-b9573c804941 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:44.358674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613d7c8-1b98-4dc2-a9ac-ca8137907fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:44.359432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613d7c8-1b98-4dc2-a9ac-ca8137907fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.359777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613d7c8-1b98-4dc2-a9ac-ca8137907fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.360112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613d7c8-1b98-4dc2-a9ac-ca8137907fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.363673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613d7c8-1b98-4dc2-a9ac-ca8137907fc4 None admin] RBAC: Adding query filter params (role.id=1790dd5eeda1419ca41830c6448c63fe, scope.project.id=b77ea42af6f745e0af87a131f9212231, user.id=1829e1ee957144f7aae3cc64ec22ab1a) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:44.364068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613d7c8-1b98-4dc2-a9ac-ca8137907fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:44.365621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613d7c8-1b98-4dc2-a9ac-ca8137907fc4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:44.372444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 99/192] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:44 2022] GET /identity/v3/role_assignments?user.id=1829e1ee957144f7aae3cc64ec22ab1a&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:44.373379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613d7c8-1b98-4dc2-a9ac-ca8137907fc4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:44.398456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:44.406692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:44.445231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6de288-8c9b-433b-93e1-590504ad90dc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:44.490493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7f4fa-0e20-4664-b13a-7836ef69115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:44.492915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7f4fa-0e20-4664-b13a-7836ef69115d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.493384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7f4fa-0e20-4664-b13a-7836ef69115d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.493955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7f4fa-0e20-4664-b13a-7836ef69115d None admin] PATH_INFO: `/v3/users/9eb51c485e504d0eb486201a2544be08` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.511844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613d7c8-1b98-4dc2-a9ac-ca8137907fc4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:44.512223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7f4fa-0e20-4664-b13a-7836ef69115d None admin] RBAC: Authorizing `identity:get_user(user_id=9eb51c485e504d0eb486201a2544be08)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:44.513997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7f4fa-0e20-4664-b13a-7836ef69115d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:44.515965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 94/193] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:44 2022] GET /identity/v3/users/9eb51c485e504d0eb486201a2544be08 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:44.517207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7f4fa-0e20-4664-b13a-7836ef69115d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:44.562778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c45bc-4bff-4019-a02b-43601b95b992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:44.563685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c45bc-4bff-4019-a02b-43601b95b992 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.563975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c45bc-4bff-4019-a02b-43601b95b992 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.564387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c45bc-4bff-4019-a02b-43601b95b992 None admin] PATH_INFO: `/v3/users/9eb51c485e504d0eb486201a2544be08` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.565835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c45bc-4bff-4019-a02b-43601b95b992 None admin] RBAC: Authorizing `identity:get_user(user_id=9eb51c485e504d0eb486201a2544be08)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:44.567496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c45bc-4bff-4019-a02b-43601b95b992 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:44.569384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 100/194] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:44 2022] GET /identity/v3/users/9eb51c485e504d0eb486201a2544be08 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:44.572505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c45bc-4bff-4019-a02b-43601b95b992 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:44.643205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7f4fa-0e20-4664-b13a-7836ef69115d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:44.675298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:44.679005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:44.688020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f322e-07a1-4d06-a468-295dedead2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:44.688871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f322e-07a1-4d06-a468-295dedead2bf None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.689193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f322e-07a1-4d06-a468-295dedead2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.689458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f322e-07a1-4d06-a468-295dedead2bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.690687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f322e-07a1-4d06-a468-295dedead2bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:44.692126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f322e-07a1-4d06-a468-295dedead2bf None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:44.698364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 95/195] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:44.698364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f322e-07a1-4d06-a468-295dedead2bf None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:44.698546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c45bc-4bff-4019-a02b-43601b95b992 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:44.731564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116c605-d0fd-4856-8a8a-9e22b76cc403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:44.732358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116c605-d0fd-4856-8a8a-9e22b76cc403 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.732638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116c605-d0fd-4856-8a8a-9e22b76cc403 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.732940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116c605-d0fd-4856-8a8a-9e22b76cc403 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.743191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116c605-d0fd-4856-8a8a-9e22b76cc403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d116c605-d0fd-4856-8a8a-9e22b76cc403 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:44.750950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:44.752129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:44.752994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 101/196] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:44.753639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116c605-d0fd-4856-8a8a-9e22b76cc403 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:44.798194 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f322e-07a1-4d06-a468-295dedead2bf None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:44.831508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f5084-6252-4549-984a-98689cc9524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:44.832165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f5084-6252-4549-984a-98689cc9524e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.832453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f5084-6252-4549-984a-98689cc9524e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.832761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f5084-6252-4549-984a-98689cc9524e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.850771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116c605-d0fd-4856-8a8a-9e22b76cc403 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:44.882784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa20863-73b5-438a-801a-1daf3911d1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:44.883455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa20863-73b5-438a-801a-1daf3911d1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:44.883733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa20863-73b5-438a-801a-1daf3911d1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:44.884006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa20863-73b5-438a-801a-1daf3911d1a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:44.892818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:44.898997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:44.899995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f5084-6252-4549-984a-98689cc9524e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:44.901911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f5084-6252-4549-984a-98689cc9524e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:44.951580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa20863-73b5-438a-801a-1daf3911d1a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:44.953002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa20863-73b5-438a-801a-1daf3911d1a2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:45.003740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 96/197] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:45.004540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f5084-6252-4549-984a-98689cc9524e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:45.056950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 102/198] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:45.060059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa20863-73b5-438a-801a-1daf3911d1a2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:45.099778 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:45.105887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f5084-6252-4549-984a-98689cc9524e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:45.107414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:45.140368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50eb83-9781-49b0-ab67-f2ff74c0a5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:45.141079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50eb83-9781-49b0-ab67-f2ff74c0a5db None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:45.141367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50eb83-9781-49b0-ab67-f2ff74c0a5db None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:45.141642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50eb83-9781-49b0-ab67-f2ff74c0a5db None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:45.142436 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50eb83-9781-49b0-ab67-f2ff74c0a5db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:45.143890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50eb83-9781-49b0-ab67-f2ff74c0a5db None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:45.163728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 97/199] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:04:45 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:04:45.163906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa20863-73b5-438a-801a-1daf3911d1a2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:45.164537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50eb83-9781-49b0-ab67-f2ff74c0a5db None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:45.211684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277f8ca-8db6-4843-91bd-1819b5ff99bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:45.212488 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277f8ca-8db6-4843-91bd-1819b5ff99bf None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:45.212872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277f8ca-8db6-4843-91bd-1819b5ff99bf None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:45.213216 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277f8ca-8db6-4843-91bd-1819b5ff99bf None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:45.214101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277f8ca-8db6-4843-91bd-1819b5ff99bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:45.214480 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277f8ca-8db6-4843-91bd-1819b5ff99bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:45.215974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277f8ca-8db6-4843-91bd-1819b5ff99bf None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:45.225364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 103/200] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:45.226233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277f8ca-8db6-4843-91bd-1819b5ff99bf None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:45.285083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50eb83-9781-49b0-ab67-f2ff74c0a5db None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:45.324350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf20aa-9afd-4de6-b5b8-1d33d57a0d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:45.325627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf20aa-9afd-4de6-b5b8-1d33d57a0d3f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:45.325903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf20aa-9afd-4de6-b5b8-1d33d57a0d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:45.326173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf20aa-9afd-4de6-b5b8-1d33d57a0d3f None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:45.327378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf20aa-9afd-4de6-b5b8-1d33d57a0d3f None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:45.329298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf20aa-9afd-4de6-b5b8-1d33d57a0d3f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:45.331387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 98/201] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:45 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:45.331387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf20aa-9afd-4de6-b5b8-1d33d57a0d3f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:45.343461 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277f8ca-8db6-4843-91bd-1819b5ff99bf None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:45.355547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:45.365322 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:45.402826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92a5f3-7408-424d-9adb-0b4e03eb8df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:45.403869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92a5f3-7408-424d-9adb-0b4e03eb8df6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:45.404229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92a5f3-7408-424d-9adb-0b4e03eb8df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:45.404762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92a5f3-7408-424d-9adb-0b4e03eb8df6 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:45.406032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92a5f3-7408-424d-9adb-0b4e03eb8df6 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:45.407590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92a5f3-7408-424d-9adb-0b4e03eb8df6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:45.410209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 104/202] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:45 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:45.410621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92a5f3-7408-424d-9adb-0b4e03eb8df6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:45.471233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf20aa-9afd-4de6-b5b8-1d33d57a0d3f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:45.511032 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5c0d-f0c5-456a-9dd4-69335e6d53cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:45.511917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5c0d-f0c5-456a-9dd4-69335e6d53cc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:45.512195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5c0d-f0c5-456a-9dd4-69335e6d53cc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:45.512477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5c0d-f0c5-456a-9dd4-69335e6d53cc None admin] PATH_INFO: `/v3/users/56938789392a4d5992c5aab53eb62da1` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:45.514239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f5c0d-f0c5-456a-9dd4-69335e6d53cc None admin] RBAC: Authorizing `identity:get_user(user_id=56938789392a4d5992c5aab53eb62da1)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:45.515245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f5c0d-f0c5-456a-9dd4-69335e6d53cc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:45.517121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 99/203] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:45 2022] GET /identity/v3/users/56938789392a4d5992c5aab53eb62da1 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:45.518291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5c0d-f0c5-456a-9dd4-69335e6d53cc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:45.530474 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92a5f3-7408-424d-9adb-0b4e03eb8df6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:45.575672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5703b0-5c63-49a9-a330-9900c5e3c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:45.577679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5703b0-5c63-49a9-a330-9900c5e3c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:45.578112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5703b0-5c63-49a9-a330-9900c5e3c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:45.578541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5703b0-5c63-49a9-a330-9900c5e3c0f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:45.579557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5703b0-5c63-49a9-a330-9900c5e3c0f1 None admin] RBAC: Adding query filter params (role.id=45788771d2f1494a801cc09d365ff9e2, scope.project.id=68adc705690343aca7cbb550db0fe39c, user.id=9eb51c485e504d0eb486201a2544be08) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:45.580115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5703b0-5c63-49a9-a330-9900c5e3c0f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:45.582304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5703b0-5c63-49a9-a330-9900c5e3c0f1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:45.590593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 105/204] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:45 2022] GET /identity/v3/role_assignments?user.id=9eb51c485e504d0eb486201a2544be08&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=45788771d2f1494a801cc09d365ff9e2 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:45.592713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5703b0-5c63-49a9-a330-9900c5e3c0f1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:45.627812 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:45.650192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5c0d-f0c5-456a-9dd4-69335e6d53cc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:45.669552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:45.701896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a20ec-0394-4dfd-b7b5-0952536967f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:45.702861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a20ec-0394-4dfd-b7b5-0952536967f9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:45.703323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a20ec-0394-4dfd-b7b5-0952536967f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:45.703739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a20ec-0394-4dfd-b7b5-0952536967f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:45.705179 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a20ec-0394-4dfd-b7b5-0952536967f9 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=68adc705690343aca7cbb550db0fe39c, user.id=9eb51c485e504d0eb486201a2544be08) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:45.705723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a20ec-0394-4dfd-b7b5-0952536967f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:45.707546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a20ec-0394-4dfd-b7b5-0952536967f9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:45.714533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 100/205] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:45 2022] GET /identity/v3/role_assignments?user.id=9eb51c485e504d0eb486201a2544be08&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:45.803711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5703b0-5c63-49a9-a330-9900c5e3c0f1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:45.846569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba64ef9-b2cf-45ad-8bda-e1087c955cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:45.847257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba64ef9-b2cf-45ad-8bda-e1087c955cbc None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:45.847540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba64ef9-b2cf-45ad-8bda-e1087c955cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:45.847813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba64ef9-b2cf-45ad-8bda-e1087c955cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:45.938489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba64ef9-b2cf-45ad-8bda-e1087c955cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:45.940296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba64ef9-b2cf-45ad-8bda-e1087c955cbc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:45.997169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:46.081537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 106/206] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:46.087453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a20ec-0394-4dfd-b7b5-0952536967f9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:46.216402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a20ec-0394-4dfd-b7b5-0952536967f9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:46.252202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aab0d-8059-43ca-a509-947d82ce36f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:46.253364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aab0d-8059-43ca-a509-947d82ce36f4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:46.253786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aab0d-8059-43ca-a509-947d82ce36f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:46.254208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aab0d-8059-43ca-a509-947d82ce36f4 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:46.255552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aab0d-8059-43ca-a509-947d82ce36f4 None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:46.257202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aab0d-8059-43ca-a509-947d82ce36f4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:46.259104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 101/207] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:46 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:46.270049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba64ef9-b2cf-45ad-8bda-e1087c955cbc None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:46.416780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba64ef9-b2cf-45ad-8bda-e1087c955cbc None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:46.452843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ede7c-b3fa-4524-be18-56f0d6374919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:46.453514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ede7c-b3fa-4524-be18-56f0d6374919 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:46.453794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ede7c-b3fa-4524-be18-56f0d6374919 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:46.454069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ede7c-b3fa-4524-be18-56f0d6374919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:46.455121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ede7c-b3fa-4524-be18-56f0d6374919 None admin] RBAC: Adding query filter params (role.id=86fb57959e444c5ba2f9385f06d32865, scope.project.id=b77ea42af6f745e0af87a131f9212231, user.id=56938789392a4d5992c5aab53eb62da1) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:46.455435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ede7c-b3fa-4524-be18-56f0d6374919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:46.456931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ede7c-b3fa-4524-be18-56f0d6374919 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:46.463258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 107/208] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:46 2022] GET /identity/v3/role_assignments?user.id=56938789392a4d5992c5aab53eb62da1&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=86fb57959e444c5ba2f9385f06d32865 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:47.538653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de9d8-dc19-4b26-8c4a-474fde2e0198 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:47.539205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de9d8-dc19-4b26-8c4a-474fde2e0198 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:47.539205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de9d8-dc19-4b26-8c4a-474fde2e0198 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:47.540577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 102/209] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:47.545906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d3884-78e8-4a5a-846f-0ee86d563030 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:47.546624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d3884-78e8-4a5a-846f-0ee86d563030 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:47.546951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d3884-78e8-4a5a-846f-0ee86d563030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:47.553363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:47.564883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ce4d3884-78e8-4a5a-846f-0ee86d563030 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:47.566942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ce4d3884-78e8-4a5a-846f-0ee86d563030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:47.597995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688c915-7791-4d23-b0bf-2112242ff7cf None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:47.598298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688c915-7791-4d23-b0bf-2112242ff7cf None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:47.598560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688c915-7791-4d23-b0bf-2112242ff7cf None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:47.600163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 103/210] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:47.605150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fcd33-e7fc-4906-97a9-8f5f19990eb7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:47.605439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fcd33-e7fc-4906-97a9-8f5f19990eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:47.605715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fcd33-e7fc-4906-97a9-8f5f19990eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:47.627027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-870fcd33-e7fc-4906-97a9-8f5f19990eb7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:47.628836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-870fcd33-e7fc-4906-97a9-8f5f19990eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:47.636100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 108/211] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:47.645279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:47.661349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d3884-78e8-4a5a-846f-0ee86d563030 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:47.714739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 104/212] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:47.738057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fcd33-e7fc-4906-97a9-8f5f19990eb7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:47.769299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d3884-78e8-4a5a-846f-0ee86d563030 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:47.806444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6582e-197e-4d88-af07-bd7e7b4fde19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:47.807246 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6582e-197e-4d88-af07-bd7e7b4fde19 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:47.807524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6582e-197e-4d88-af07-bd7e7b4fde19 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:47.807797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6582e-197e-4d88-af07-bd7e7b4fde19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:47.809004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6582e-197e-4d88-af07-bd7e7b4fde19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:47.810449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6582e-197e-4d88-af07-bd7e7b4fde19 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:47.812057 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 109/213] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:47.817789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6582e-197e-4d88-af07-bd7e7b4fde19 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:47.820747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:47.854350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fcd33-e7fc-4906-97a9-8f5f19990eb7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:47.898307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2ec5f-86cc-4716-9823-11e2c1510d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:47.899024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2ec5f-86cc-4716-9823-11e2c1510d85 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:47.899308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2ec5f-86cc-4716-9823-11e2c1510d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:47.899581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2ec5f-86cc-4716-9823-11e2c1510d85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:47.910101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2ec5f-86cc-4716-9823-11e2c1510d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f4f2ec5f-86cc-4716-9823-11e2c1510d85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:47.917858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:47.918746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:47.919518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 105/214] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:47.922710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665818b-1654-4d13-a14e-ca258205ee80 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:47.923000 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665818b-1654-4d13-a14e-ca258205ee80 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:47.923274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665818b-1654-4d13-a14e-ca258205ee80 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:47.924732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 106/215] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:47.925482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665818b-1654-4d13-a14e-ca258205ee80 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:47.931729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6582e-197e-4d88-af07-bd7e7b4fde19 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:47.939992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:47.968045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e0a98-76f3-4d31-b2ec-26a987d652ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:47.968788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0a98-76f3-4d31-b2ec-26a987d652ac None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:47.969074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0a98-76f3-4d31-b2ec-26a987d652ac None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:47.969351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0a98-76f3-4d31-b2ec-26a987d652ac None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:47.970172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e0a98-76f3-4d31-b2ec-26a987d652ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:47.971619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e0a98-76f3-4d31-b2ec-26a987d652ac None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:48.000701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 110/216] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:04:47 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:04:48.000701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee45b-2f94-4795-a77c-1c20e8bed11d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:48.000701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee45b-2f94-4795-a77c-1c20e8bed11d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:48.000701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee45b-2f94-4795-a77c-1c20e8bed11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:48.024058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-657ee45b-2f94-4795-a77c-1c20e8bed11d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:48.025384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-657ee45b-2f94-4795-a77c-1c20e8bed11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:48.052379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665818b-1654-4d13-a14e-ca258205ee80 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:48.093777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a4e5-2aea-4007-a9ff-190b8436c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:48.094706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a4e5-2aea-4007-a9ff-190b8436c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:48.094994 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a4e5-2aea-4007-a9ff-190b8436c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:48.095272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a4e5-2aea-4007-a9ff-190b8436c4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:48.096191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1a4e5-2aea-4007-a9ff-190b8436c4a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:48.096501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1a4e5-2aea-4007-a9ff-190b8436c4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:48.097995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1a4e5-2aea-4007-a9ff-190b8436c4a4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:48.105132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:48.108721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 107/217] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:48.114153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 111/218] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:48.115216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a4e5-2aea-4007-a9ff-190b8436c4a4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:48.142254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee45b-2f94-4795-a77c-1c20e8bed11d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:48.206241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:48.239395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a4e5-2aea-4007-a9ff-190b8436c4a4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:48.274117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee45b-2f94-4795-a77c-1c20e8bed11d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:48.281686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f839446-eb50-40a1-9083-a628af3cd60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:48.282553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839446-eb50-40a1-9083-a628af3cd60e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:48.282553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839446-eb50-40a1-9083-a628af3cd60e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:48.282758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839446-eb50-40a1-9083-a628af3cd60e None admin] PATH_INFO: `/v3/users/3958e0f8629f4310b1814a984122a3a5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:48.300581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f839446-eb50-40a1-9083-a628af3cd60e None admin] RBAC: Authorizing `identity:get_user(user_id=3958e0f8629f4310b1814a984122a3a5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:48.302076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f839446-eb50-40a1-9083-a628af3cd60e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:48.304124 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 108/219] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:48 2022] GET /identity/v3/users/3958e0f8629f4310b1814a984122a3a5 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:48.305492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a65a-88d0-4651-912e-db72366e0006 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:48.305874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a65a-88d0-4651-912e-db72366e0006 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:48.306046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a65a-88d0-4651-912e-db72366e0006 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:48.308168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 109/220] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:48.311855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a65a-88d0-4651-912e-db72366e0006 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:48.328283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ee9a1-9711-4b7a-809f-96aa160ba474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:48.329791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ee9a1-9711-4b7a-809f-96aa160ba474 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:48.330648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ee9a1-9711-4b7a-809f-96aa160ba474 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:48.331211 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ee9a1-9711-4b7a-809f-96aa160ba474 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:48.344783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ee9a1-9711-4b7a-809f-96aa160ba474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-536ee9a1-9711-4b7a-809f-96aa160ba474 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:48.352882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:48.353872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:48.354673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 112/221] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:04:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:04:48.355551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196972-f6f0-4343-aedf-032245eba773 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:48.355793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196972-f6f0-4343-aedf-032245eba773 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:48.356068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196972-f6f0-4343-aedf-032245eba773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:48.381634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0a196972-f6f0-4343-aedf-032245eba773 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:48.382829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0a196972-f6f0-4343-aedf-032245eba773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:48.441973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:48.449320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a65a-88d0-4651-912e-db72366e0006 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:48.469625 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 113/222] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:48.477362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196972-f6f0-4343-aedf-032245eba773 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:48.485420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:48.492251 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48552ad3-58a7-439e-9f15-9507ca0133ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:48.492957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48552ad3-58a7-439e-9f15-9507ca0133ad None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:48.493246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48552ad3-58a7-439e-9f15-9507ca0133ad None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:48.493520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48552ad3-58a7-439e-9f15-9507ca0133ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:48.582401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48552ad3-58a7-439e-9f15-9507ca0133ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:48.584035 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48552ad3-58a7-439e-9f15-9507ca0133ad None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:48.600393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196972-f6f0-4343-aedf-032245eba773 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:48.644794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94f01-3769-42a2-8d31-f94acca45f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:48.645484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94f01-3769-42a2-8d31-f94acca45f0d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:48.645766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94f01-3769-42a2-8d31-f94acca45f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:48.646041 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94f01-3769-42a2-8d31-f94acca45f0d None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:48.647058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94f01-3769-42a2-8d31-f94acca45f0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:48.647374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94f01-3769-42a2-8d31-f94acca45f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:48.649168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94f01-3769-42a2-8d31-f94acca45f0d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:48.660933 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 114/223] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:04:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:48.662122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94f01-3769-42a2-8d31-f94acca45f0d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:48.707472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 110/224] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:48.708473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48552ad3-58a7-439e-9f15-9507ca0133ad None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:48.710851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:48.747990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:48.792301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94f01-3769-42a2-8d31-f94acca45f0d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:48.826830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48552ad3-58a7-439e-9f15-9507ca0133ad None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:48.838029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073ae6-84a0-46f3-8c2a-c910c3b9b18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:48.839592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073ae6-84a0-46f3-8c2a-c910c3b9b18a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:48.840311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073ae6-84a0-46f3-8c2a-c910c3b9b18a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:48.840824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073ae6-84a0-46f3-8c2a-c910c3b9b18a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:48.856237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a073ae6-84a0-46f3-8c2a-c910c3b9b18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:48.863990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604c32-3800-4996-ac6d-092c8f90bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:48.864919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604c32-3800-4996-ac6d-092c8f90bcca None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:48.865202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604c32-3800-4996-ac6d-092c8f90bcca None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:48.865473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604c32-3800-4996-ac6d-092c8f90bcca None admin] PATH_INFO: `/v3/users/9eb51c485e504d0eb486201a2544be08` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:48.866678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a604c32-3800-4996-ac6d-092c8f90bcca None admin] RBAC: Authorizing `identity:get_user(user_id=9eb51c485e504d0eb486201a2544be08)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-3a073ae6-84a0-46f3-8c2a-c910c3b9b18a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:48.866795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:48.867610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:48.868393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:48.869014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a604c32-3800-4996-ac6d-092c8f90bcca None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:48.869923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 111/225] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:48 2022] GET /identity/v3/users/9eb51c485e504d0eb486201a2544be08 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:48.871054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604c32-3800-4996-ac6d-092c8f90bcca None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:48.871556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 115/226] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:48.881797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073ae6-84a0-46f3-8c2a-c910c3b9b18a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:48.984766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:48.990111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604c32-3800-4996-ac6d-092c8f90bcca None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:48.999940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:49.003995 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073ae6-84a0-46f3-8c2a-c910c3b9b18a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:49.037370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a486ac0-f4f7-43b4-89f3-6e4b85821ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:49.038426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486ac0-f4f7-43b4-89f3-6e4b85821ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:49.038712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486ac0-f4f7-43b4-89f3-6e4b85821ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:49.038984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486ac0-f4f7-43b4-89f3-6e4b85821ae2 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:49.040449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a486ac0-f4f7-43b4-89f3-6e4b85821ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:49.041220 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cba6d9-10f7-4b0b-aa9d-5cbe41c4f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:49.042112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a486ac0-f4f7-43b4-89f3-6e4b85821ae2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:49.042407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cba6d9-10f7-4b0b-aa9d-5cbe41c4f550 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:49.042790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cba6d9-10f7-4b0b-aa9d-5cbe41c4f550 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:49.043165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cba6d9-10f7-4b0b-aa9d-5cbe41c4f550 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:49.044124 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 112/227] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:48 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:49.044228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cba6d9-10f7-4b0b-aa9d-5cbe41c4f550 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:49.044564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cba6d9-10f7-4b0b-aa9d-5cbe41c4f550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:49.044981 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a486ac0-f4f7-43b4-89f3-6e4b85821ae2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:49.046658 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cba6d9-10f7-4b0b-aa9d-5cbe41c4f550 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:49.057079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 116/228] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:49.058011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cba6d9-10f7-4b0b-aa9d-5cbe41c4f550 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:49.183648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a486ac0-f4f7-43b4-89f3-6e4b85821ae2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:49.184161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cba6d9-10f7-4b0b-aa9d-5cbe41c4f550 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:49.219882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70a759-9364-45b6-b70a-8823746ee6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:49.220547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70a759-9364-45b6-b70a-8823746ee6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:49.220874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70a759-9364-45b6-b70a-8823746ee6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:49.221149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70a759-9364-45b6-b70a-8823746ee6e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:49.221987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70a759-9364-45b6-b70a-8823746ee6e6 None admin] RBAC: Adding query filter params (role.id=1790dd5eeda1419ca41830c6448c63fe, scope.project.id=68adc705690343aca7cbb550db0fe39c, user.id=3958e0f8629f4310b1814a984122a3a5) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:49.222298 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70a759-9364-45b6-b70a-8823746ee6e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:49.223752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70a759-9364-45b6-b70a-8823746ee6e6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:49.227564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45efac-b6ee-4039-b960-1bf2b2318c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:49.228756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45efac-b6ee-4039-b960-1bf2b2318c37 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:49.229043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45efac-b6ee-4039-b960-1bf2b2318c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:49.229316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45efac-b6ee-4039-b960-1bf2b2318c37 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:49.229752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 117/229] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:49 2022] GET /identity/v3/role_assignments?user.id=3958e0f8629f4310b1814a984122a3a5&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:49.230543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45efac-b6ee-4039-b960-1bf2b2318c37 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:49.232045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45efac-b6ee-4039-b960-1bf2b2318c37 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:49.237778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70a759-9364-45b6-b70a-8823746ee6e6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:49.238745 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 113/230] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:49 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:49.239750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45efac-b6ee-4039-b960-1bf2b2318c37 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:49.284734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:49.310591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:49.402703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45efac-b6ee-4039-b960-1bf2b2318c37 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:49.434137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70a759-9364-45b6-b70a-8823746ee6e6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:49.476901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ae1d9-dfaa-4c57-9ea5-6fddd9973672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:49.477973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ae1d9-dfaa-4c57-9ea5-6fddd9973672 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:49.478257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ae1d9-dfaa-4c57-9ea5-6fddd9973672 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:49.478531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ae1d9-dfaa-4c57-9ea5-6fddd9973672 None admin] PATH_INFO: `/v3/users/9eb51c485e504d0eb486201a2544be08` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:49.479843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ae1d9-dfaa-4c57-9ea5-6fddd9973672 None admin] RBAC: Authorizing `identity:get_user(user_id=9eb51c485e504d0eb486201a2544be08)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:49.480621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ea4a5-6e00-47f7-a91c-0c203a483ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:49.481459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ae1d9-dfaa-4c57-9ea5-6fddd9973672 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:49.481652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ea4a5-6e00-47f7-a91c-0c203a483ffc None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:49.481896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ea4a5-6e00-47f7-a91c-0c203a483ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:49.482173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ea4a5-6e00-47f7-a91c-0c203a483ffc None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c/users/9eb51c485e504d0eb486201a2544be08/roles/45788771d2f1494a801cc09d365ff9e2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:49.483611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 118/231] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:49 2022] GET /identity/v3/users/9eb51c485e504d0eb486201a2544be08 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:49.485907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ea4a5-6e00-47f7-a91c-0c203a483ffc None admin] RBAC: Authorizing `identity:create_grant(project_id=68adc705690343aca7cbb550db0fe39c, user_id=9eb51c485e504d0eb486201a2544be08, role_id=45788771d2f1494a801cc09d365ff9e2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:49.487357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ea4a5-6e00-47f7-a91c-0c203a483ffc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:49.488567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ae1d9-dfaa-4c57-9ea5-6fddd9973672 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:49.509339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 114/232] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:04:49 2022] PUT /identity/v3/projects/68adc705690343aca7cbb550db0fe39c/users/9eb51c485e504d0eb486201a2544be08/roles/45788771d2f1494a801cc09d365ff9e2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:04:49.630023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:49.637635 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ae1d9-dfaa-4c57-9ea5-6fddd9973672 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:49.675668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f168278-5da0-453b-83ea-49c1c953550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:49.676552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f168278-5da0-453b-83ea-49c1c953550f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:49.676876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f168278-5da0-453b-83ea-49c1c953550f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:49.677148 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f168278-5da0-453b-83ea-49c1c953550f None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:49.678402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f168278-5da0-453b-83ea-49c1c953550f None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:49.679868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f168278-5da0-453b-83ea-49c1c953550f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:49.681953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 119/233] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:49 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:49.687650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ea4a5-6e00-47f7-a91c-0c203a483ffc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:49.798815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:49.805901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ea4a5-6e00-47f7-a91c-0c203a483ffc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:49.843926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50e80c-e099-49f7-9024-9378f830cd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:49.844943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50e80c-e099-49f7-9024-9378f830cd50 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:49.845221 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50e80c-e099-49f7-9024-9378f830cd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:49.845492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50e80c-e099-49f7-9024-9378f830cd50 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c/users/9eb51c485e504d0eb486201a2544be08/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:49.847503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50e80c-e099-49f7-9024-9378f830cd50 None admin] RBAC: Authorizing `identity:create_grant(project_id=68adc705690343aca7cbb550db0fe39c, user_id=9eb51c485e504d0eb486201a2544be08, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:49.848973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50e80c-e099-49f7-9024-9378f830cd50 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:49.868739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 115/234] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:04:49 2022] PUT /identity/v3/projects/68adc705690343aca7cbb550db0fe39c/users/9eb51c485e504d0eb486201a2544be08/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:04:50.355380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d696c-c709-48e2-82ed-6127faf45faf None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:50.355613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53e54-fd35-4de6-b56e-1a5d6cd28dd4 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:50.355695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d696c-c709-48e2-82ed-6127faf45faf None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:50.355962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d696c-c709-48e2-82ed-6127faf45faf None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:50.356447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53e54-fd35-4de6-b56e-1a5d6cd28dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:50.356979 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53e54-fd35-4de6-b56e-1a5d6cd28dd4 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:50.357563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 120/235] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:50.358928 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 116/236] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:50.363396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99aa91-a6d2-4c46-941b-f28e02924a89 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:50.363536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99aa91-a6d2-4c46-941b-f28e02924a89 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:50.363766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99aa91-a6d2-4c46-941b-f28e02924a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:50.370264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f683c9-c005-4582-8079-a0e24f389b0c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:50.370837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f683c9-c005-4582-8079-a0e24f389b0c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:50.371312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f683c9-c005-4582-8079-a0e24f389b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:50.389675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-fa99aa91-a6d2-4c46-941b-f28e02924a89 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:50.391044 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fa99aa91-a6d2-4c46-941b-f28e02924a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:50.394369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f6f683c9-c005-4582-8079-a0e24f389b0c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:50.395954 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f6f683c9-c005-4582-8079-a0e24f389b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:50.517906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 121/237] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:50.525868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 117/238] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:50.550372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99aa91-a6d2-4c46-941b-f28e02924a89 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:50.560609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f683c9-c005-4582-8079-a0e24f389b0c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:50.686837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:50.708035 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f683c9-c005-4582-8079-a0e24f389b0c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:50.744310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:50.747368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55931134-14f6-4273-92e8-562426598111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:50.748514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55931134-14f6-4273-92e8-562426598111 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:50.749025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55931134-14f6-4273-92e8-562426598111 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:50.749511 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55931134-14f6-4273-92e8-562426598111 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:50.751131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55931134-14f6-4273-92e8-562426598111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:50.752842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55931134-14f6-4273-92e8-562426598111 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:50.755043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 118/239] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:50.759682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99aa91-a6d2-4c46-941b-f28e02924a89 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:50.761235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55931134-14f6-4273-92e8-562426598111 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:50.836116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093093a-cb26-4a79-95b9-53f9904025f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:50.837344 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093093a-cb26-4a79-95b9-53f9904025f2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:50.837856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093093a-cb26-4a79-95b9-53f9904025f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:50.838359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093093a-cb26-4a79-95b9-53f9904025f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:50.863498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093093a-cb26-4a79-95b9-53f9904025f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-1093093a-cb26-4a79-95b9-53f9904025f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:50.880375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:50.881321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:50.882160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:50.885746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 122/240] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:50.891974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093093a-cb26-4a79-95b9-53f9904025f2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:50.974168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55931134-14f6-4273-92e8-562426598111 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:51.051709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962469-db25-4848-8f73-6ac7be2b3042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:51.052396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962469-db25-4848-8f73-6ac7be2b3042 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:51.052686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962469-db25-4848-8f73-6ac7be2b3042 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:51.053025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962469-db25-4848-8f73-6ac7be2b3042 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:51.053751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60962469-db25-4848-8f73-6ac7be2b3042 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:51.055193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60962469-db25-4848-8f73-6ac7be2b3042 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:51.068572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093093a-cb26-4a79-95b9-53f9904025f2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:51.104045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 119/241] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:04:50 2022] POST /identity/v3/users => generated 293 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:04:51.117390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f2b5b-62da-43fb-aa2f-b964ba4608db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:51.118565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f2b5b-62da-43fb-aa2f-b964ba4608db None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:51.119210 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f2b5b-62da-43fb-aa2f-b964ba4608db None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:51.119741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f2b5b-62da-43fb-aa2f-b964ba4608db None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:51.120989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f2b5b-62da-43fb-aa2f-b964ba4608db None admin] RBAC: Adding query filter params (name=reader) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:51.122047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f2b5b-62da-43fb-aa2f-b964ba4608db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:51.123925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f2b5b-62da-43fb-aa2f-b964ba4608db None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:51.140178 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 123/242] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:51.146747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962469-db25-4848-8f73-6ac7be2b3042 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:51.175888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:51.309074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962469-db25-4848-8f73-6ac7be2b3042 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:51.358417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b9dc5-4275-4f43-9702-8985f71035e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:51.359351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9dc5-4275-4f43-9702-8985f71035e8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:51.359773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9dc5-4275-4f43-9702-8985f71035e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:51.360166 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9dc5-4275-4f43-9702-8985f71035e8 None admin] PATH_INFO: `/v3/users/5580e0a9ffcb46788c57e15df2dc4773` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:51.387148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b9dc5-4275-4f43-9702-8985f71035e8 None admin] RBAC: Authorizing `identity:get_user(user_id=5580e0a9ffcb46788c57e15df2dc4773)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:51.388634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b9dc5-4275-4f43-9702-8985f71035e8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:51.390770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 120/243] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:51 2022] GET /identity/v3/users/5580e0a9ffcb46788c57e15df2dc4773 => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:51.396468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f2b5b-62da-43fb-aa2f-b964ba4608db None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:51.419400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:51.523343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f2b5b-62da-43fb-aa2f-b964ba4608db None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:51.572511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5819142-43dd-4b09-a8da-61990b16bd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:51.573619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5819142-43dd-4b09-a8da-61990b16bd83 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:51.574124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5819142-43dd-4b09-a8da-61990b16bd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:51.574605 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5819142-43dd-4b09-a8da-61990b16bd83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:51.647228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5819142-43dd-4b09-a8da-61990b16bd83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:51.647413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a0a17-8e18-438f-8138-32c0c6c49b66 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:51.647655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a0a17-8e18-438f-8138-32c0c6c49b66 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:51.647931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a0a17-8e18-438f-8138-32c0c6c49b66 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:51.649171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5819142-43dd-4b09-a8da-61990b16bd83 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:51.649589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 121/244] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:51.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2c18-863c-48e4-8329-c503bd19df85 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:51.657438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2c18-863c-48e4-8329-c503bd19df85 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:51.657715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2c18-863c-48e4-8329-c503bd19df85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:51.666138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:51.694465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c42b2c18-863c-48e4-8329-c503bd19df85 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:51.697614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c42b2c18-863c-48e4-8329-c503bd19df85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:51.768132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 124/245] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:51.774807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5819142-43dd-4b09-a8da-61990b16bd83 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:51.787890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:51.798400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 122/246] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:51.825856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b2c18-863c-48e4-8329-c503bd19df85 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:51.882874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5819142-43dd-4b09-a8da-61990b16bd83 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:51.898820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:51.926414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7f39b-b977-49c5-be68-7e9634316d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:51.927299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7f39b-b977-49c5-be68-7e9634316d1f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:51.927580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7f39b-b977-49c5-be68-7e9634316d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:51.927849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7f39b-b977-49c5-be68-7e9634316d1f None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:51.929267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7f39b-b977-49c5-be68-7e9634316d1f None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:51.931313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7f39b-b977-49c5-be68-7e9634316d1f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:51.933705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 125/247] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:51 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:51.935963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4a1e-269c-4f5d-bbd1-c6a4637412eb None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:51.936249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4a1e-269c-4f5d-bbd1-c6a4637412eb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:51.936523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4a1e-269c-4f5d-bbd1-c6a4637412eb None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:51.938122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 126/248] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:51.942936 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4a1e-269c-4f5d-bbd1-c6a4637412eb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:51.986137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b2c18-863c-48e4-8329-c503bd19df85 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:52.024290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14cd08-07be-446e-930d-99cc168cdb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:52.025276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14cd08-07be-446e-930d-99cc168cdb81 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:52.025580 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14cd08-07be-446e-930d-99cc168cdb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:52.025861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14cd08-07be-446e-930d-99cc168cdb81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:52.040808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14cd08-07be-446e-930d-99cc168cdb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3d14cd08-07be-446e-930d-99cc168cdb81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:52.050871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:52.051830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:52.052648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 123/249] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:04:52.058251 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d99d-6bc3-4e88-b52f-644fabc86905 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:52.058554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d99d-6bc3-4e88-b52f-644fabc86905 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:52.058823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d99d-6bc3-4e88-b52f-644fabc86905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:52.079355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4a1e-269c-4f5d-bbd1-c6a4637412eb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:52.081037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e524d99d-6bc3-4e88-b52f-644fabc86905 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:52.083412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e524d99d-6bc3-4e88-b52f-644fabc86905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:52.122138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f7f5b-c9e6-4ab6-bb33-1baa21ecc85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:52.123335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f7f5b-c9e6-4ab6-bb33-1baa21ecc85d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:52.124120 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f7f5b-c9e6-4ab6-bb33-1baa21ecc85d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:52.124919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f7f5b-c9e6-4ab6-bb33-1baa21ecc85d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:52.126175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f7f5b-c9e6-4ab6-bb33-1baa21ecc85d None admin] RBAC: Adding query filter params (role.id=86fb57959e444c5ba2f9385f06d32865, scope.project.id=68adc705690343aca7cbb550db0fe39c, user.id=5580e0a9ffcb46788c57e15df2dc4773) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:52.126798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f7f5b-c9e6-4ab6-bb33-1baa21ecc85d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:52.128476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f7f5b-c9e6-4ab6-bb33-1baa21ecc85d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:52.136503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 127/250] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:51 2022] GET /identity/v3/role_assignments?user.id=5580e0a9ffcb46788c57e15df2dc4773&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=86fb57959e444c5ba2f9385f06d32865 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:52.137626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f7f5b-c9e6-4ab6-bb33-1baa21ecc85d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:52.189080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:52.230238 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 124/251] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:52.260265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:52.266018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524d99d-6bc3-4e88-b52f-644fabc86905 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:52.344331 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f7f5b-c9e6-4ab6-bb33-1baa21ecc85d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:52.382754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fdd5-cc9d-4379-b3b8-84c25b860c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:52.383432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fdd5-cc9d-4379-b3b8-84c25b860c84 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:52.383710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fdd5-cc9d-4379-b3b8-84c25b860c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:52.383981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fdd5-cc9d-4379-b3b8-84c25b860c84 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:52.384808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1fdd5-cc9d-4379-b3b8-84c25b860c84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:52.385119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1fdd5-cc9d-4379-b3b8-84c25b860c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:52.386496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1fdd5-cc9d-4379-b3b8-84c25b860c84 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:52.402113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 128/252] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:52.407819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fdd5-cc9d-4379-b3b8-84c25b860c84 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:52.484326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524d99d-6bc3-4e88-b52f-644fabc86905 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:52.523459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fdd5-cc9d-4379-b3b8-84c25b860c84 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:52.533044 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:52.559117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3067248-668c-46c4-bb3b-8110a25c3755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:52.560006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067248-668c-46c4-bb3b-8110a25c3755 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:52.560287 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067248-668c-46c4-bb3b-8110a25c3755 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:52.560555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067248-668c-46c4-bb3b-8110a25c3755 None admin] PATH_INFO: `/v3/users/3958e0f8629f4310b1814a984122a3a5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:52.561869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3067248-668c-46c4-bb3b-8110a25c3755 None admin] RBAC: Authorizing `identity:get_user(user_id=3958e0f8629f4310b1814a984122a3a5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:52.563840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3067248-668c-46c4-bb3b-8110a25c3755 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:52.565861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 129/253] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:52 2022] GET /identity/v3/users/3958e0f8629f4310b1814a984122a3a5 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:52.572127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3067248-668c-46c4-bb3b-8110a25c3755 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:52.583761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa4c3-3814-42eb-80a0-0225f4319246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:52.584597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa4c3-3814-42eb-80a0-0225f4319246 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:52.584898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa4c3-3814-42eb-80a0-0225f4319246 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:52.585168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa4c3-3814-42eb-80a0-0225f4319246 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:52.606364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aa4c3-3814-42eb-80a0-0225f4319246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-fc0aa4c3-3814-42eb-80a0-0225f4319246 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:52.614827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:52.615741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:52.616540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 125/254] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:04:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:04:52.624200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa4c3-3814-42eb-80a0-0225f4319246 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:52.716495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:52.749761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3067248-668c-46c4-bb3b-8110a25c3755 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:52.814628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa4c3-3814-42eb-80a0-0225f4319246 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:52.818255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264112b-a6af-440c-99f8-ebf7c74672e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:52.819135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264112b-a6af-440c-99f8-ebf7c74672e1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:52.819413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264112b-a6af-440c-99f8-ebf7c74672e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:52.819679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264112b-a6af-440c-99f8-ebf7c74672e1 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:52.825056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264112b-a6af-440c-99f8-ebf7c74672e1 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:52.826509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264112b-a6af-440c-99f8-ebf7c74672e1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:52.830470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 130/255] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:52 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:52.831743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e53b6-b77c-46c6-80a4-45ec9924abc9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:52.832024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e53b6-b77c-46c6-80a4-45ec9924abc9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:52.832296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e53b6-b77c-46c6-80a4-45ec9924abc9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:52.835034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 131/256] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:52.835742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e53b6-b77c-46c6-80a4-45ec9924abc9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:52.876391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8502-edda-40f4-852f-febf037c7b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:52.877506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8502-edda-40f4-852f-febf037c7b00 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:52.878031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8502-edda-40f4-852f-febf037c7b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:52.878520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8502-edda-40f4-852f-febf037c7b00 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:52.879475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8502-edda-40f4-852f-febf037c7b00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:52.879995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8502-edda-40f4-852f-febf037c7b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:52.881611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8502-edda-40f4-852f-febf037c7b00 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:52.893029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:52.900690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 126/257] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:04:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:52.902252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca6d02-b282-4af8-afde-7d86ed4777da None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:52.902736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca6d02-b282-4af8-afde-7d86ed4777da None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:52.903225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca6d02-b282-4af8-afde-7d86ed4777da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:52.939070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a9ca6d02-b282-4af8-afde-7d86ed4777da None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:52.940254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a9ca6d02-b282-4af8-afde-7d86ed4777da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:52.970403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e53b6-b77c-46c6-80a4-45ec9924abc9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:53.030559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524873a-83cd-4f50-91f4-b6d176665574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:53.031522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524873a-83cd-4f50-91f4-b6d176665574 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:53.031795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524873a-83cd-4f50-91f4-b6d176665574 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:53.032065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524873a-83cd-4f50-91f4-b6d176665574 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c/users/3958e0f8629f4310b1814a984122a3a5/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:53.034861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524873a-83cd-4f50-91f4-b6d176665574 None admin] RBAC: Authorizing `identity:create_grant(project_id=68adc705690343aca7cbb550db0fe39c, user_id=3958e0f8629f4310b1814a984122a3a5, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:53.036341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524873a-83cd-4f50-91f4-b6d176665574 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:53.042391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 127/258] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:53.043272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca6d02-b282-4af8-afde-7d86ed4777da None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:53.068584 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 132/259] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:04:52 2022] PUT /identity/v3/projects/68adc705690343aca7cbb550db0fe39c/users/3958e0f8629f4310b1814a984122a3a5/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:04:53.098697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524873a-83cd-4f50-91f4-b6d176665574 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:53.102092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:53.211666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca6d02-b282-4af8-afde-7d86ed4777da None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:53.229995 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524873a-83cd-4f50-91f4-b6d176665574 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:53.233239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:53.274016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4116a-0878-4eba-b9b5-0e6364ea8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:53.275180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4116a-0878-4eba-b9b5-0e6364ea8101 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:53.275604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4116a-0878-4eba-b9b5-0e6364ea8101 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:53.275714 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcd1ea-85ff-4c0d-9369-1f470b9ba033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:53.276149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4116a-0878-4eba-b9b5-0e6364ea8101 None admin] PATH_INFO: `/v3/users/9eb51c485e504d0eb486201a2544be08` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:53.276753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd1ea-85ff-4c0d-9369-1f470b9ba033 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:53.280794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd1ea-85ff-4c0d-9369-1f470b9ba033 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:53.280794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd1ea-85ff-4c0d-9369-1f470b9ba033 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:53.281786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4116a-0878-4eba-b9b5-0e6364ea8101 None admin] RBAC: Authorizing `identity:get_user(user_id=9eb51c485e504d0eb486201a2544be08)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:53.283451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4116a-0878-4eba-b9b5-0e6364ea8101 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:53.285391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 128/260] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:53 2022] GET /identity/v3/users/9eb51c485e504d0eb486201a2544be08 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:53.290772 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4116a-0878-4eba-b9b5-0e6364ea8101 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:53.292352 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcd1ea-85ff-4c0d-9369-1f470b9ba033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-15dcd1ea-85ff-4c0d-9369-1f470b9ba033 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:53.301789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:53.302721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:53.303523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 133/261] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:04:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:53.312063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcd1ea-85ff-4c0d-9369-1f470b9ba033 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:53.439576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4116a-0878-4eba-b9b5-0e6364ea8101 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:53.450997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:53.466088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcd1ea-85ff-4c0d-9369-1f470b9ba033 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:53.502402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbafd8-047f-4597-b24f-7fb339ce81c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:53.503152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4c3b-70e6-4986-961c-4d3651af8a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:53.503510 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbafd8-047f-4597-b24f-7fb339ce81c4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:53.503822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4c3b-70e6-4986-961c-4d3651af8a56 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:53.504113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4c3b-70e6-4986-961c-4d3651af8a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:53.504240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbafd8-047f-4597-b24f-7fb339ce81c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:53.504386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4c3b-70e6-4986-961c-4d3651af8a56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:53.504804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbafd8-047f-4597-b24f-7fb339ce81c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:53.505705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbafd8-047f-4597-b24f-7fb339ce81c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:53.506246 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbafd8-047f-4597-b24f-7fb339ce81c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:53.507779 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbafd8-047f-4597-b24f-7fb339ce81c4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:53.517652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 134/262] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:53.527664 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbafd8-047f-4597-b24f-7fb339ce81c4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:53.582559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:53.652133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc4c3b-70e6-4986-961c-4d3651af8a56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:53.653689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc4c3b-70e6-4986-961c-4d3651af8a56 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:53.720938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbafd8-047f-4597-b24f-7fb339ce81c4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:53.786053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8676-e1bf-401f-bf8e-18e3096c4d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:53.788169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8676-e1bf-401f-bf8e-18e3096c4d98 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:53.788460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8676-e1bf-401f-bf8e-18e3096c4d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:53.788761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8676-e1bf-401f-bf8e-18e3096c4d98 None admin] PATH_INFO: `/v3/users/9eb51c485e504d0eb486201a2544be08` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:53.791169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c8676-e1bf-401f-bf8e-18e3096c4d98 None admin] RBAC: Authorizing `identity:get_user(user_id=9eb51c485e504d0eb486201a2544be08)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:53.792634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c8676-e1bf-401f-bf8e-18e3096c4d98 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:53.794308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 135/263] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:53 2022] GET /identity/v3/users/9eb51c485e504d0eb486201a2544be08 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:53.801574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8676-e1bf-401f-bf8e-18e3096c4d98 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:53.812125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 129/264] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:04:53.817299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4c3b-70e6-4986-961c-4d3651af8a56 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:53.827919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:53.999229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:54.011953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8676-e1bf-401f-bf8e-18e3096c4d98 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:54.029611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4c3b-70e6-4986-961c-4d3651af8a56 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:54.074978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc1e02-28fc-45c9-a86e-5ded1a5c03c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:54.075644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1e02-28fc-45c9-a86e-5ded1a5c03c0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:54.075931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1e02-28fc-45c9-a86e-5ded1a5c03c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:54.076209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1e02-28fc-45c9-a86e-5ded1a5c03c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:54.092726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193833c-0550-4ac6-a756-c22c70079f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:54.093663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193833c-0550-4ac6-a756-c22c70079f0b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:54.093945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193833c-0550-4ac6-a756-c22c70079f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:54.094215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193833c-0550-4ac6-a756-c22c70079f0b None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:54.095449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193833c-0550-4ac6-a756-c22c70079f0b None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:54.096924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193833c-0550-4ac6-a756-c22c70079f0b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:54.098645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 130/265] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:53 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:54.105189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193833c-0550-4ac6-a756-c22c70079f0b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:54.206156 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc1e02-28fc-45c9-a86e-5ded1a5c03c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:54.207942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc1e02-28fc-45c9-a86e-5ded1a5c03c0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:54.247925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:54.306118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193833c-0550-4ac6-a756-c22c70079f0b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:54.332914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:54.349005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 136/266] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:54.350261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc1e02-28fc-45c9-a86e-5ded1a5c03c0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:54.387983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05565dca-cdfd-414f-ade6-037222a9364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:54.388734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05565dca-cdfd-414f-ade6-037222a9364c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:54.389023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05565dca-cdfd-414f-ade6-037222a9364c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:54.389302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05565dca-cdfd-414f-ade6-037222a9364c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:54.390384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05565dca-cdfd-414f-ade6-037222a9364c None admin] RBAC: Adding query filter params (role.id=45788771d2f1494a801cc09d365ff9e2, scope.project.id=68adc705690343aca7cbb550db0fe39c, user.id=9eb51c485e504d0eb486201a2544be08) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:54.390703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05565dca-cdfd-414f-ade6-037222a9364c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:54.392157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05565dca-cdfd-414f-ade6-037222a9364c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:54.412232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 131/267] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:54 2022] GET /identity/v3/role_assignments?user.id=9eb51c485e504d0eb486201a2544be08&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=45788771d2f1494a801cc09d365ff9e2 => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:54.480262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc1e02-28fc-45c9-a86e-5ded1a5c03c0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:54.534709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca94102-ba2b-4591-b4c7-966474af39b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:54.535580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca94102-ba2b-4591-b4c7-966474af39b3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:54.535857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca94102-ba2b-4591-b4c7-966474af39b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:54.536128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca94102-ba2b-4591-b4c7-966474af39b3 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:54.537339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca94102-ba2b-4591-b4c7-966474af39b3 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:54.538799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca94102-ba2b-4591-b4c7-966474af39b3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:54.540544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 137/268] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:54 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:54.548867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05565dca-cdfd-414f-ade6-037222a9364c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:54.551142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815a8a8-09f7-40a5-845b-837ddd527147 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:54.551428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815a8a8-09f7-40a5-845b-837ddd527147 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:54.551822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815a8a8-09f7-40a5-845b-837ddd527147 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:54.553580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 138/269] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:54.559138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c662bf7-61c5-4741-9468-a5685fa53287 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:54.559371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c662bf7-61c5-4741-9468-a5685fa53287 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:54.559626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c662bf7-61c5-4741-9468-a5685fa53287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:54.577589 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3c662bf7-61c5-4741-9468-a5685fa53287 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:54.579517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3c662bf7-61c5-4741-9468-a5685fa53287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:54.681105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:54.695653 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 139/270] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:54.711466 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05565dca-cdfd-414f-ade6-037222a9364c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:54.735028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c662bf7-61c5-4741-9468-a5685fa53287 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:54.749575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d3c6f-fc7c-4a27-bf8a-133401abd511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:54.750699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d3c6f-fc7c-4a27-bf8a-133401abd511 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:54.751128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d3c6f-fc7c-4a27-bf8a-133401abd511 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:54.751532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d3c6f-fc7c-4a27-bf8a-133401abd511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:54.752501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d3c6f-fc7c-4a27-bf8a-133401abd511 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=68adc705690343aca7cbb550db0fe39c, user.id=9eb51c485e504d0eb486201a2544be08) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:54.752978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d3c6f-fc7c-4a27-bf8a-133401abd511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:54.754665 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d3c6f-fc7c-4a27-bf8a-133401abd511 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:54.761220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 132/271] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:54 2022] GET /identity/v3/role_assignments?user.id=9eb51c485e504d0eb486201a2544be08&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:54.847652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1f467-b64d-4b5f-960c-ee04d5a5cfd6 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:54.848796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1f467-b64d-4b5f-960c-ee04d5a5cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:54.849301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1f467-b64d-4b5f-960c-ee04d5a5cfd6 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:54.851390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 133/272] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:54.860748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e07e-399b-4a00-8b94-a3e15a031cd0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:54.861377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e07e-399b-4a00-8b94-a3e15a031cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:54.861858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e07e-399b-4a00-8b94-a3e15a031cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:54.867357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:54.891184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-36d8e07e-399b-4a00-8b94-a3e15a031cd0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:54.892833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-36d8e07e-399b-4a00-8b94-a3e15a031cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:54.913292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c662bf7-61c5-4741-9468-a5685fa53287 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:54.974708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 134/273] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:54.975921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de271c-7c62-4d45-a71f-f3eb5800d6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:54.977674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de271c-7c62-4d45-a71f-f3eb5800d6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:54.977674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de271c-7c62-4d45-a71f-f3eb5800d6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:54.977674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de271c-7c62-4d45-a71f-f3eb5800d6b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:54.990675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de271c-7c62-4d45-a71f-f3eb5800d6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d6de271c-7c62-4d45-a71f-f3eb5800d6b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:54.998498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:54.999867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:55.001296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 140/274] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:04:55.003293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e07e-399b-4a00-8b94-a3e15a031cd0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:55.005265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de271c-7c62-4d45-a71f-f3eb5800d6b5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:55.066015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:55.116259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e07e-399b-4a00-8b94-a3e15a031cd0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:55.119706 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de271c-7c62-4d45-a71f-f3eb5800d6b5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:55.149722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:55.155429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f3ad2-a250-480e-b0c0-2e47ac152ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:55.156863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3ad2-a250-480e-b0c0-2e47ac152ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.157759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3ad2-a250-480e-b0c0-2e47ac152ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.158551 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3ad2-a250-480e-b0c0-2e47ac152ee8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.160044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f3ad2-a250-480e-b0c0-2e47ac152ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:55.160491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cb8a2-c0b2-48cd-bef3-c12a6a671cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:55.161419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cb8a2-c0b2-48cd-bef3-c12a6a671cfd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.161591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f3ad2-a250-480e-b0c0-2e47ac152ee8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:55.162060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cb8a2-c0b2-48cd-bef3-c12a6a671cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.162527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cb8a2-c0b2-48cd-bef3-c12a6a671cfd None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.163353 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 135/275] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:55.163944 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cb8a2-c0b2-48cd-bef3-c12a6a671cfd None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:55.164546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cb8a2-c0b2-48cd-bef3-c12a6a671cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:55.166143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cb8a2-c0b2-48cd-bef3-c12a6a671cfd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:55.168781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f3ad2-a250-480e-b0c0-2e47ac152ee8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:55.176383 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 141/276] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:55.181819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cb8a2-c0b2-48cd-bef3-c12a6a671cfd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:55.274978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f3ad2-a250-480e-b0c0-2e47ac152ee8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:55.295792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cb8a2-c0b2-48cd-bef3-c12a6a671cfd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:55.311441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578eee8-7458-4409-9154-dae8d583dfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:55.312086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:55.313108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578eee8-7458-4409-9154-dae8d583dfa2 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.313553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578eee8-7458-4409-9154-dae8d583dfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.314314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578eee8-7458-4409-9154-dae8d583dfa2 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.314905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578eee8-7458-4409-9154-dae8d583dfa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:55.316941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578eee8-7458-4409-9154-dae8d583dfa2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:55.335595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e92eaa-d9c2-49b6-a1e7-13e4f7052259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:55.336805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e92eaa-d9c2-49b6-a1e7-13e4f7052259 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.337247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e92eaa-d9c2-49b6-a1e7-13e4f7052259 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.337760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e92eaa-d9c2-49b6-a1e7-13e4f7052259 None admin] PATH_INFO: `/v3/users/b0fa360ab2c042afb113099169ddae76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.341607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 136/277] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:04:55 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:04:55.367049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e92eaa-d9c2-49b6-a1e7-13e4f7052259 None admin] RBAC: Authorizing `identity:get_user(user_id=b0fa360ab2c042afb113099169ddae76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:55.369006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e92eaa-d9c2-49b6-a1e7-13e4f7052259 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:55.371244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 142/278] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:55 2022] GET /identity/v3/users/b0fa360ab2c042afb113099169ddae76 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:55.378111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578eee8-7458-4409-9154-dae8d583dfa2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:55.440444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2251ad-b2d0-48e2-abd6-78021687956d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.440753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2251ad-b2d0-48e2-abd6-78021687956d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.441035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2251ad-b2d0-48e2-abd6-78021687956d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.442645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 143/279] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:04:55.448445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346be78-b610-4fee-8d69-b903db0e2899 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.448767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346be78-b610-4fee-8d69-b903db0e2899 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.449051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346be78-b610-4fee-8d69-b903db0e2899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.451569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:55.468252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5346be78-b610-4fee-8d69-b903db0e2899 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:55.469678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5346be78-b610-4fee-8d69-b903db0e2899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:55.501882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578eee8-7458-4409-9154-dae8d583dfa2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:55.546025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4220eb-e0a5-483e-8ba0-0f619e93bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:55.546860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4220eb-e0a5-483e-8ba0-0f619e93bef6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.547149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4220eb-e0a5-483e-8ba0-0f619e93bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.547429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4220eb-e0a5-483e-8ba0-0f619e93bef6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.548285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4220eb-e0a5-483e-8ba0-0f619e93bef6 None admin] RBAC: Adding query filter params (role.id=1790dd5eeda1419ca41830c6448c63fe, user.id=b0fa360ab2c042afb113099169ddae76, scope.system=all) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:55.548643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4220eb-e0a5-483e-8ba0-0f619e93bef6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:55.550172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4220eb-e0a5-483e-8ba0-0f619e93bef6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:55.555631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 144/280] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:55.556309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 137/281] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jul 14 09:04:55 2022] GET /identity/v3/role_assignments?user.id=b0fa360ab2c042afb113099169ddae76&scope.system=all&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:55.578968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346be78-b610-4fee-8d69-b903db0e2899 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:55.703626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346be78-b610-4fee-8d69-b903db0e2899 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:55.705640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:55.746661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305a562-adc2-404b-bb58-72bb295118af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:55.747468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305a562-adc2-404b-bb58-72bb295118af None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.747751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305a562-adc2-404b-bb58-72bb295118af None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.748024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305a562-adc2-404b-bb58-72bb295118af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.760463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa988fbb-2f92-4e3b-b66d-01288e92c690 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.761175 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa988fbb-2f92-4e3b-b66d-01288e92c690 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.761387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305a562-adc2-404b-bb58-72bb295118af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:55.761835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa988fbb-2f92-4e3b-b66d-01288e92c690 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.763681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 138/282] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:04:55.768608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8589e-7080-4287-b0d3-41c4476bfa7d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.769258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8589e-7080-4287-b0d3-41c4476bfa7d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c305a562-adc2-404b-bb58-72bb295118af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:55.769576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:55.770434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:55.771258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:04:55.772520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8589e-7080-4287-b0d3-41c4476bfa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.774679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 145/283] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:55.777238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305a562-adc2-404b-bb58-72bb295118af None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:55.793929 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-33d8589e-7080-4287-b0d3-41c4476bfa7d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:55.796498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-33d8589e-7080-4287-b0d3-41c4476bfa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:55.892607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 139/284] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:55.895468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305a562-adc2-404b-bb58-72bb295118af None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:55.922870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8589e-7080-4287-b0d3-41c4476bfa7d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:55.952135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c3389-e6ee-4ccd-b951-8b436f3428bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:55.953108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c3389-e6ee-4ccd-b951-8b436f3428bf None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:55.953396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c3389-e6ee-4ccd-b951-8b436f3428bf None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:55.953731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c3389-e6ee-4ccd-b951-8b436f3428bf None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:55.954449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c3389-e6ee-4ccd-b951-8b436f3428bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:55.954757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c3389-e6ee-4ccd-b951-8b436f3428bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:55.956236 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c3389-e6ee-4ccd-b951-8b436f3428bf None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:55.978635 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 146/285] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:04:55.985240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c3389-e6ee-4ccd-b951-8b436f3428bf None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:56.001011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:56.014986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:56.106037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8589e-7080-4287-b0d3-41c4476bfa7d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:56.109276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c3389-e6ee-4ccd-b951-8b436f3428bf None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:56.175341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef955fcc-85bc-4c2d-93e7-257df8f700e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:56.176151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef955fcc-85bc-4c2d-93e7-257df8f700e1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:56.176424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef955fcc-85bc-4c2d-93e7-257df8f700e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:56.176707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef955fcc-85bc-4c2d-93e7-257df8f700e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:56.180154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c51b-90a5-4008-917a-6d9b23119d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:56.181060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c51b-90a5-4008-917a-6d9b23119d28 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:56.181335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c51b-90a5-4008-917a-6d9b23119d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:56.181602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c51b-90a5-4008-917a-6d9b23119d28 None admin] PATH_INFO: `/v3/users/5580e0a9ffcb46788c57e15df2dc4773` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:56.182904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c51b-90a5-4008-917a-6d9b23119d28 None admin] RBAC: Authorizing `identity:get_user(user_id=5580e0a9ffcb46788c57e15df2dc4773)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:56.184348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c51b-90a5-4008-917a-6d9b23119d28 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:56.187289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 147/286] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:55 2022] GET /identity/v3/users/5580e0a9ffcb46788c57e15df2dc4773 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:56.191652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c51b-90a5-4008-917a-6d9b23119d28 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:56.205698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef955fcc-85bc-4c2d-93e7-257df8f700e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-ef955fcc-85bc-4c2d-93e7-257df8f700e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:56.213983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:56.214881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:56.215687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:56.216287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 140/287] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:56.221630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef955fcc-85bc-4c2d-93e7-257df8f700e1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:56.368644 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef955fcc-85bc-4c2d-93e7-257df8f700e1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:56.394272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c51b-90a5-4008-917a-6d9b23119d28 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:56.398349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:56.409054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:56.435108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1bd6d-3799-40ac-9606-e9b7881d75b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:56.437853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1bd6d-3799-40ac-9606-e9b7881d75b7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:56.439045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1bd6d-3799-40ac-9606-e9b7881d75b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:56.440088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1bd6d-3799-40ac-9606-e9b7881d75b7 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:56.442735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1bd6d-3799-40ac-9606-e9b7881d75b7 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:56.445985 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1bd6d-3799-40ac-9606-e9b7881d75b7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:56.448043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 148/288] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:56 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:56.452427 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33740f1f-444f-414c-9086-ce4b6d26abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:56.454054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1bd6d-3799-40ac-9606-e9b7881d75b7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:56.454588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33740f1f-444f-414c-9086-ce4b6d26abf0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:56.455011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33740f1f-444f-414c-9086-ce4b6d26abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:56.455868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33740f1f-444f-414c-9086-ce4b6d26abf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:56.457143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33740f1f-444f-414c-9086-ce4b6d26abf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:56.459368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33740f1f-444f-414c-9086-ce4b6d26abf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:56.460933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33740f1f-444f-414c-9086-ce4b6d26abf0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:56.481136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 141/289] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:56.486143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33740f1f-444f-414c-9086-ce4b6d26abf0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:56.594157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1bd6d-3799-40ac-9606-e9b7881d75b7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:56.631526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0fa3b-6ccd-4bf6-9268-ebc9bbfa040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:56.632744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0fa3b-6ccd-4bf6-9268-ebc9bbfa040f None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:56.633169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0fa3b-6ccd-4bf6-9268-ebc9bbfa040f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:56.633609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0fa3b-6ccd-4bf6-9268-ebc9bbfa040f None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c/users/5580e0a9ffcb46788c57e15df2dc4773/roles/86fb57959e444c5ba2f9385f06d32865` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:56.635720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0fa3b-6ccd-4bf6-9268-ebc9bbfa040f None admin] RBAC: Authorizing `identity:create_grant(project_id=68adc705690343aca7cbb550db0fe39c, user_id=5580e0a9ffcb46788c57e15df2dc4773, role_id=86fb57959e444c5ba2f9385f06d32865)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:56.637436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0fa3b-6ccd-4bf6-9268-ebc9bbfa040f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:56.652735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 149/290] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:04:56 2022] PUT /identity/v3/projects/68adc705690343aca7cbb550db0fe39c/users/5580e0a9ffcb46788c57e15df2dc4773/roles/86fb57959e444c5ba2f9385f06d32865 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:04:56.663613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33740f1f-444f-414c-9086-ce4b6d26abf0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:56.718389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c06e41-e98b-4990-8e2b-0ea0e7f354d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:56.719196 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c06e41-e98b-4990-8e2b-0ea0e7f354d5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:56.719473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c06e41-e98b-4990-8e2b-0ea0e7f354d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:56.719741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c06e41-e98b-4990-8e2b-0ea0e7f354d5 None admin] PATH_INFO: `/v3/users/3958e0f8629f4310b1814a984122a3a5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:56.720969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c06e41-e98b-4990-8e2b-0ea0e7f354d5 None admin] RBAC: Authorizing `identity:get_user(user_id=3958e0f8629f4310b1814a984122a3a5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:56.722399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c06e41-e98b-4990-8e2b-0ea0e7f354d5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:56.724323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 142/291] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:56 2022] GET /identity/v3/users/3958e0f8629f4310b1814a984122a3a5 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:56.729715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0fa3b-6ccd-4bf6-9268-ebc9bbfa040f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:56.764378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:56.887122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0fa3b-6ccd-4bf6-9268-ebc9bbfa040f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:56.926119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349eca3-06e7-449a-94d6-dc310c22a95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:56.927016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349eca3-06e7-449a-94d6-dc310c22a95f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:56.927444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349eca3-06e7-449a-94d6-dc310c22a95f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:56.927856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349eca3-06e7-449a-94d6-dc310c22a95f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:57.000261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349eca3-06e7-449a-94d6-dc310c22a95f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:57.001980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349eca3-06e7-449a-94d6-dc310c22a95f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:57.023910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:57.105691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 150/292] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:04:57.113766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c06e41-e98b-4990-8e2b-0ea0e7f354d5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:57.187906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:57.267569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c06e41-e98b-4990-8e2b-0ea0e7f354d5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:57.310329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d41003-8e14-47e5-8738-d7f6bf43b37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:57.311240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d41003-8e14-47e5-8738-d7f6bf43b37a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:57.311687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d41003-8e14-47e5-8738-d7f6bf43b37a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:57.312123 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d41003-8e14-47e5-8738-d7f6bf43b37a None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:57.313348 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d41003-8e14-47e5-8738-d7f6bf43b37a None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:57.314789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d41003-8e14-47e5-8738-d7f6bf43b37a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:57.316650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 143/293] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:04:57 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:57.322340 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349eca3-06e7-449a-94d6-dc310c22a95f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:57.451333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349eca3-06e7-449a-94d6-dc310c22a95f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:57.472846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:57.487750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007c5bc-404d-4016-b0f6-8f8b12164322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:57.488416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c5bc-404d-4016-b0f6-8f8b12164322 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:57.488831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c5bc-404d-4016-b0f6-8f8b12164322 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:57.488999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c5bc-404d-4016-b0f6-8f8b12164322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:57.489846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007c5bc-404d-4016-b0f6-8f8b12164322 None admin] RBAC: Adding query filter params (role.id=1790dd5eeda1419ca41830c6448c63fe, scope.project.id=68adc705690343aca7cbb550db0fe39c, user.id=3958e0f8629f4310b1814a984122a3a5) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:57.490158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007c5bc-404d-4016-b0f6-8f8b12164322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:57.491606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007c5bc-404d-4016-b0f6-8f8b12164322 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:57.498219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 151/294] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:04:57 2022] GET /identity/v3/role_assignments?user.id=3958e0f8629f4310b1814a984122a3a5&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:57.782074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1212b1e-fa4e-4bba-bf2f-89590ab5b3af None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:57.782479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1212b1e-fa4e-4bba-bf2f-89590ab5b3af None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:57.782674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1212b1e-fa4e-4bba-bf2f-89590ab5b3af None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:57.784288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 144/295] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:57.789547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa9816-dcd9-48a8-9fb3-97bee5e35b25 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:57.789837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa9816-dcd9-48a8-9fb3-97bee5e35b25 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:57.790116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa9816-dcd9-48a8-9fb3-97bee5e35b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:57.810443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-51fa9816-dcd9-48a8-9fb3-97bee5e35b25 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:57.811718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-51fa9816-dcd9-48a8-9fb3-97bee5e35b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:57.891541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 152/296] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:57.919227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1212b1e-fa4e-4bba-bf2f-89590ab5b3af None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:57.998852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b11c0-f714-4ab0-a070-03712636f94b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:57.998852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b11c0-f714-4ab0-a070-03712636f94b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:57.998852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b11c0-f714-4ab0-a070-03712636f94b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:57.999974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 153/297] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:04:58.005780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849054-ecfb-46ca-8c93-353328bdbeca None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.006062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849054-ecfb-46ca-8c93-353328bdbeca None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.006332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849054-ecfb-46ca-8c93-353328bdbeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.023968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-10849054-ecfb-46ca-8c93-353328bdbeca None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:58.025176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-10849054-ecfb-46ca-8c93-353328bdbeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:58.049371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1212b1e-fa4e-4bba-bf2f-89590ab5b3af None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:58.060149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:58.093229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d4972-3cd0-42c3-85f7-67e37ef62879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:58.094149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d4972-3cd0-42c3-85f7-67e37ef62879 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.094490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d4972-3cd0-42c3-85f7-67e37ef62879 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.094826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d4972-3cd0-42c3-85f7-67e37ef62879 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.109034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d4972-3cd0-42c3-85f7-67e37ef62879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:58.111013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 154/298] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-9b0d4972-3cd0-42c3-85f7-67e37ef62879 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:58.121479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:58.122982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:58.124072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:58.126198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 145/299] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:58.136693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849054-ecfb-46ca-8c93-353328bdbeca None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:58.139349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d4972-3cd0-42c3-85f7-67e37ef62879 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:58.183656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:58.244525 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849054-ecfb-46ca-8c93-353328bdbeca None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:58.247317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d4972-3cd0-42c3-85f7-67e37ef62879 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:58.278633 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13e8e6-95fd-4f2e-b7e8-019ebd06b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:58.279269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13e8e6-95fd-4f2e-b7e8-019ebd06b0dd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.279637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13e8e6-95fd-4f2e-b7e8-019ebd06b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.279970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13e8e6-95fd-4f2e-b7e8-019ebd06b0dd None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.280755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13e8e6-95fd-4f2e-b7e8-019ebd06b0dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:58.281061 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13e8e6-95fd-4f2e-b7e8-019ebd06b0dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:58.282420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13e8e6-95fd-4f2e-b7e8-019ebd06b0dd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:58.284984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429ff80-bf7a-416d-ac4c-3a6d6d0b110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:58.285942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429ff80-bf7a-416d-ac4c-3a6d6d0b110e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.286367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429ff80-bf7a-416d-ac4c-3a6d6d0b110e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.286779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429ff80-bf7a-416d-ac4c-3a6d6d0b110e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.292703 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 155/300] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:58.292703 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02f2c7-8bc3-4b74-b8a5-bc62cd4e9487 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.292703 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02f2c7-8bc3-4b74-b8a5-bc62cd4e9487 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.292980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02f2c7-8bc3-4b74-b8a5-bc62cd4e9487 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.294426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 156/301] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:58.298256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02f2c7-8bc3-4b74-b8a5-bc62cd4e9487 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:58.304622 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429ff80-bf7a-416d-ac4c-3a6d6d0b110e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d429ff80-bf7a-416d-ac4c-3a6d6d0b110e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:58.312597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:58.313653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:04:58.314608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:58.318820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 146/302] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:04:58.320075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17ab30-7cf2-48df-b6ef-603bf9ebdc6d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.320359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17ab30-7cf2-48df-b6ef-603bf9ebdc6d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.320630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17ab30-7cf2-48df-b6ef-603bf9ebdc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.337540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7b17ab30-7cf2-48df-b6ef-603bf9ebdc6d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:58.338708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7b17ab30-7cf2-48df-b6ef-603bf9ebdc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:58.361523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:58.410332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 147/303] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:58.411362 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17ab30-7cf2-48df-b6ef-603bf9ebdc6d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:58.432391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02f2c7-8bc3-4b74-b8a5-bc62cd4e9487 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:58.442976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:58.477182 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8b2d7-9379-4ec0-84d7-20c4e9f39077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:58.478323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8b2d7-9379-4ec0-84d7-20c4e9f39077 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.478612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8b2d7-9379-4ec0-84d7-20c4e9f39077 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.478886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8b2d7-9379-4ec0-84d7-20c4e9f39077 None admin] PATH_INFO: `/v3/users/8084cd6c0ba7462bb832b1ae73dedef3` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.494230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8b2d7-9379-4ec0-84d7-20c4e9f39077 None admin] RBAC: Authorizing `identity:get_user(user_id=8084cd6c0ba7462bb832b1ae73dedef3)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:58.495786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8b2d7-9379-4ec0-84d7-20c4e9f39077 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:58.497670 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 157/304] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:58 2022] GET /identity/v3/users/8084cd6c0ba7462bb832b1ae73dedef3 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:58.498412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8b2d7-9379-4ec0-84d7-20c4e9f39077 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:58.524134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17ab30-7cf2-48df-b6ef-603bf9ebdc6d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:58.564000 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e4626-abb4-4576-9da4-e37f3d01e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:58.564594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e4626-abb4-4576-9da4-e37f3d01e6df None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.564955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e4626-abb4-4576-9da4-e37f3d01e6df None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.565234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e4626-abb4-4576-9da4-e37f3d01e6df None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.565991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e4626-abb4-4576-9da4-e37f3d01e6df None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:58.566296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e4626-abb4-4576-9da4-e37f3d01e6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:58.567663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e4626-abb4-4576-9da4-e37f3d01e6df None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:58.580907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 148/305] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:58.580907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e4626-abb4-4576-9da4-e37f3d01e6df None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:58.601179 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:58.610425 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8b2d7-9379-4ec0-84d7-20c4e9f39077 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:58.645667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80cc88-87d2-445d-abe1-604c9067bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:58.646476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80cc88-87d2-445d-abe1-604c9067bb84 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.646761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80cc88-87d2-445d-abe1-604c9067bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.647038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80cc88-87d2-445d-abe1-604c9067bb84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.648214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80cc88-87d2-445d-abe1-604c9067bb84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:58.649689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80cc88-87d2-445d-abe1-604c9067bb84 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:58.655755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 158/306] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:04:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:58.655755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80cc88-87d2-445d-abe1-604c9067bb84 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:58.688760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:58.690377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e4626-abb4-4576-9da4-e37f3d01e6df None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:58.727853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057abfb-4f62-487e-9556-aa2c8377ad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:58.728510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057abfb-4f62-487e-9556-aa2c8377ad2b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.728830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057abfb-4f62-487e-9556-aa2c8377ad2b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.729104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057abfb-4f62-487e-9556-aa2c8377ad2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.729946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057abfb-4f62-487e-9556-aa2c8377ad2b None admin] RBAC: Adding query filter params (role.id=86fb57959e444c5ba2f9385f06d32865, user.id=8084cd6c0ba7462bb832b1ae73dedef3, scope.system=all) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:58.730258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057abfb-4f62-487e-9556-aa2c8377ad2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:58.731705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057abfb-4f62-487e-9556-aa2c8377ad2b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:58.737343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 149/307] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jul 14 09:04:58 2022] GET /identity/v3/role_assignments?user.id=8084cd6c0ba7462bb832b1ae73dedef3&scope.system=all&role.id=86fb57959e444c5ba2f9385f06d32865 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:58.738117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057abfb-4f62-487e-9556-aa2c8377ad2b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:58.779622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80cc88-87d2-445d-abe1-604c9067bb84 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:58.822378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d1092-bd68-4d9c-9ca5-01a2a13e9da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:58.823248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d1092-bd68-4d9c-9ca5-01a2a13e9da9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.823557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d1092-bd68-4d9c-9ca5-01a2a13e9da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.823836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d1092-bd68-4d9c-9ca5-01a2a13e9da9 None admin] PATH_INFO: `/v3/users/b0fa360ab2c042afb113099169ddae76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.825863 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d1092-bd68-4d9c-9ca5-01a2a13e9da9 None admin] RBAC: Authorizing `identity:get_user(user_id=b0fa360ab2c042afb113099169ddae76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:58.827617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d1092-bd68-4d9c-9ca5-01a2a13e9da9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:58.833950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 159/308] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:58 2022] GET /identity/v3/users/b0fa360ab2c042afb113099169ddae76 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:58.836387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d1092-bd68-4d9c-9ca5-01a2a13e9da9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:58.861905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:58.881387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057abfb-4f62-487e-9556-aa2c8377ad2b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:58.927886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1500-9f2a-4e3e-9679-ab7c81ab255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:58.928574 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1500-9f2a-4e3e-9679-ab7c81ab255b None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:58.928884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1500-9f2a-4e3e-9679-ab7c81ab255b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:58.929162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1500-9f2a-4e3e-9679-ab7c81ab255b None admin] PATH_INFO: `/v3/groups` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:58.929865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d1500-9f2a-4e3e-9679-ab7c81ab255b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:58.931307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d1500-9f2a-4e3e-9679-ab7c81ab255b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:58.953665 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 150/309] 10.222.0.27 () {60 vars in 1134 bytes} [Thu Jul 14 09:04:58 2022] POST /identity/v3/groups => generated 229 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:04:58.977458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:58.984833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d1092-bd68-4d9c-9ca5-01a2a13e9da9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:59.026335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3304e-6802-41f4-bcd0-3b91483046e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:59.027975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3304e-6802-41f4-bcd0-3b91483046e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:59.028434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3304e-6802-41f4-bcd0-3b91483046e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:59.028951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3304e-6802-41f4-bcd0-3b91483046e4 None admin] PATH_INFO: `/v3/system/users/b0fa360ab2c042afb113099169ddae76/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:59.030896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3304e-6802-41f4-bcd0-3b91483046e4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b0fa360ab2c042afb113099169ddae76, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:59.032510 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3304e-6802-41f4-bcd0-3b91483046e4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:59.044239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 160/310] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Jul 14 09:04:58 2022] PUT /identity/v3/system/users/b0fa360ab2c042afb113099169ddae76/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:04:59.107050 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47629ba-f966-45cc-b527-581c8927351a None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:59.107247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47629ba-f966-45cc-b527-581c8927351a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:59.107603 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47629ba-f966-45cc-b527-581c8927351a None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:59.110069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 151/311] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:04:59.115945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8f7b2-97f2-4baf-8970-f67a2dac35b3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:59.116231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8f7b2-97f2-4baf-8970-f67a2dac35b3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:59.116509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8f7b2-97f2-4baf-8970-f67a2dac35b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:59.136153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-94a8f7b2-97f2-4baf-8970-f67a2dac35b3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:04:59.137448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-94a8f7b2-97f2-4baf-8970-f67a2dac35b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:04:59.218252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 161/312] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:04:59.242054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47629ba-f966-45cc-b527-581c8927351a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:59.350476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47629ba-f966-45cc-b527-581c8927351a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:59.389732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e195098-2455-412d-afd6-8be64833d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:59.390549 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e195098-2455-412d-afd6-8be64833d414 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:59.390842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e195098-2455-412d-afd6-8be64833d414 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:59.391119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e195098-2455-412d-afd6-8be64833d414 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:59.401979 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e195098-2455-412d-afd6-8be64833d414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-9e195098-2455-412d-afd6-8be64833d414 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:04:59.409742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:04:59.410633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:04:59.411416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 152/313] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:04:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:04:59.416868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8f7b2-97f2-4baf-8970-f67a2dac35b3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:59.521361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:59.528242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8f7b2-97f2-4baf-8970-f67a2dac35b3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:59.565342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1b29-a329-48e6-ac48-4b205f06d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:59.566086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1b29-a329-48e6-ac48-4b205f06d66e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:59.566373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1b29-a329-48e6-ac48-4b205f06d66e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:59.566650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1b29-a329-48e6-ac48-4b205f06d66e None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:59.567418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf1b29-a329-48e6-ac48-4b205f06d66e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:04:59.567724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf1b29-a329-48e6-ac48-4b205f06d66e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:59.569149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf1b29-a329-48e6-ac48-4b205f06d66e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:59.578363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 162/314] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:04:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:59.585878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e195098-2455-412d-afd6-8be64833d414 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:59.590657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:59.697460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e195098-2455-412d-afd6-8be64833d414 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:59.731465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3cbc6-0897-4c55-be37-884c5c59d1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:59.732394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3cbc6-0897-4c55-be37-884c5c59d1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:59.732723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3cbc6-0897-4c55-be37-884c5c59d1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:59.733011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3cbc6-0897-4c55-be37-884c5c59d1b6 None admin] PATH_INFO: `/v3/users/5580e0a9ffcb46788c57e15df2dc4773` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:59.734269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3cbc6-0897-4c55-be37-884c5c59d1b6 None admin] RBAC: Authorizing `identity:get_user(user_id=5580e0a9ffcb46788c57e15df2dc4773)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:59.735733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3cbc6-0897-4c55-be37-884c5c59d1b6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:04:59.737760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 153/315] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:04:59 2022] GET /identity/v3/users/5580e0a9ffcb46788c57e15df2dc4773 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:04:59.745839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1b29-a329-48e6-ac48-4b205f06d66e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:04:59.849746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1b29-a329-48e6-ac48-4b205f06d66e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:04:59.883515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce890731-e000-462d-a64d-602104660fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:04:59.884222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce890731-e000-462d-a64d-602104660fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:04:59.884502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce890731-e000-462d-a64d-602104660fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:04:59.884851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce890731-e000-462d-a64d-602104660fe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:04:59.910447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:04:59.954881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce890731-e000-462d-a64d-602104660fe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:04:59.956341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce890731-e000-462d-a64d-602104660fe2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:00.067606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 163/316] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:00.073805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3cbc6-0897-4c55-be37-884c5c59d1b6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:00.149463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:00.187811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3cbc6-0897-4c55-be37-884c5c59d1b6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:00.229036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb717620-6729-44bf-b1e8-9230869ddcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:00.229837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb717620-6729-44bf-b1e8-9230869ddcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:00.230123 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb717620-6729-44bf-b1e8-9230869ddcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:00.230404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb717620-6729-44bf-b1e8-9230869ddcc5 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:00.231617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb717620-6729-44bf-b1e8-9230869ddcc5 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:00.233348 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb717620-6729-44bf-b1e8-9230869ddcc5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:00.235431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 154/317] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:00 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:00.240891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce890731-e000-462d-a64d-602104660fe2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:00.301011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:00.342942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce890731-e000-462d-a64d-602104660fe2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:00.381218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca5f4a-f0df-48b8-9490-d3bc47634378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:00.382158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca5f4a-f0df-48b8-9490-d3bc47634378 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:00.382644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca5f4a-f0df-48b8-9490-d3bc47634378 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:00.383124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca5f4a-f0df-48b8-9490-d3bc47634378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:00.384140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca5f4a-f0df-48b8-9490-d3bc47634378 None admin] RBAC: Adding query filter params (role.id=86fb57959e444c5ba2f9385f06d32865, scope.project.id=68adc705690343aca7cbb550db0fe39c, user.id=5580e0a9ffcb46788c57e15df2dc4773) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:00.384637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca5f4a-f0df-48b8-9490-d3bc47634378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:00.386269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca5f4a-f0df-48b8-9490-d3bc47634378 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:00.392855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 164/318] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:00 2022] GET /identity/v3/role_assignments?user.id=5580e0a9ffcb46788c57e15df2dc4773&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=86fb57959e444c5ba2f9385f06d32865 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:01.004570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9bd5-cae0-462a-8f26-67fcae4c4b22 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.005134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9bd5-cae0-462a-8f26-67fcae4c4b22 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.005134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9bd5-cae0-462a-8f26-67fcae4c4b22 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.006685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 155/319] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:01.011822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb33d6-ef9b-462e-bf6d-9e3e3829604b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.012090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb33d6-ef9b-462e-bf6d-9e3e3829604b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.012392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb33d6-ef9b-462e-bf6d-9e3e3829604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.030453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9beb33d6-ef9b-462e-bf6d-9e3e3829604b None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:01.031647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9beb33d6-ef9b-462e-bf6d-9e3e3829604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:01.074117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd948a-32b7-4283-b8e9-24e1ccdd5df2 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.074406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd948a-32b7-4283-b8e9-24e1ccdd5df2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.074849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd948a-32b7-4283-b8e9-24e1ccdd5df2 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.076507 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 156/320] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:05:01.081431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2945e-7163-4f6c-9e59-67d8c1f1a7cd None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.081725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2945e-7163-4f6c-9e59-67d8c1f1a7cd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.082005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2945e-7163-4f6c-9e59-67d8c1f1a7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.100594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-cba2945e-7163-4f6c-9e59-67d8c1f1a7cd None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:01.102074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cba2945e-7163-4f6c-9e59-67d8c1f1a7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:01.103662 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 165/321] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:01.125413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb33d6-ef9b-462e-bf6d-9e3e3829604b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:01.176017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:01.176931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 157/322] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:01.178263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffedc3-a480-4357-8752-dbb2d63d540e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.178538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffedc3-a480-4357-8752-dbb2d63d540e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.178812 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffedc3-a480-4357-8752-dbb2d63d540e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.180067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 158/323] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:01.185271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b31c-fa01-455d-bb69-35d1b4314387 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.185705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b31c-fa01-455d-bb69-35d1b4314387 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.185877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300b31c-fa01-455d-bb69-35d1b4314387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.203157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0300b31c-fa01-455d-bb69-35d1b4314387 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:01.204345 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0300b31c-fa01-455d-bb69-35d1b4314387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:01.229729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb33d6-ef9b-462e-bf6d-9e3e3829604b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:01.263840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb830e5a-1f47-44e6-b503-be6f07aedec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:01.264592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb830e5a-1f47-44e6-b503-be6f07aedec0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.264897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb830e5a-1f47-44e6-b503-be6f07aedec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.265165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb830e5a-1f47-44e6-b503-be6f07aedec0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.267442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:01.272402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 159/324] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:01.273240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300b31c-fa01-455d-bb69-35d1b4314387 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:01.280436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb830e5a-1f47-44e6-b503-be6f07aedec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-bb830e5a-1f47-44e6-b503-be6f07aedec0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:01.289278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:01.290229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:01.291606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 166/325] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:01.295016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb830e5a-1f47-44e6-b503-be6f07aedec0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:01.377272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300b31c-fa01-455d-bb69-35d1b4314387 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:01.396527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb830e5a-1f47-44e6-b503-be6f07aedec0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:01.406838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:01.411243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333a714-0f0b-442e-afe0-5c69d85edcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:01.412041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333a714-0f0b-442e-afe0-5c69d85edcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.412319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333a714-0f0b-442e-afe0-5c69d85edcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.412585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333a714-0f0b-442e-afe0-5c69d85edcd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.423243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333a714-0f0b-442e-afe0-5c69d85edcd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:01.430860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada235f-16f0-41b6-b2c1-1ff181516dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-1333a714-0f0b-442e-afe0-5c69d85edcd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:01.430976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:01.431936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:01.432755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:01.433359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada235f-16f0-41b6-b2c1-1ff181516dbf None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.433359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada235f-16f0-41b6-b2c1-1ff181516dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.433488 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 160/326] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:01.433560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada235f-16f0-41b6-b2c1-1ff181516dbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.433626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333a714-0f0b-442e-afe0-5c69d85edcd5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:01.437886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada235f-16f0-41b6-b2c1-1ff181516dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:01.439323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada235f-16f0-41b6-b2c1-1ff181516dbf None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:01.441065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 167/327] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:01.441744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada235f-16f0-41b6-b2c1-1ff181516dbf None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:01.496916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:01.539754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333a714-0f0b-442e-afe0-5c69d85edcd5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:01.541349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada235f-16f0-41b6-b2c1-1ff181516dbf None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:01.574036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d1520-7fd1-49de-9788-5f020ed8bfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:01.574700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d1520-7fd1-49de-9788-5f020ed8bfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.574975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d1520-7fd1-49de-9788-5f020ed8bfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.575245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d1520-7fd1-49de-9788-5f020ed8bfd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.575481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c533a0-36f1-43f0-a148-e09fa7f9d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:01.576039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d1520-7fd1-49de-9788-5f020ed8bfd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:01.576343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c533a0-36f1-43f0-a148-e09fa7f9d844 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.576433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d1520-7fd1-49de-9788-5f020ed8bfd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:01.576614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c533a0-36f1-43f0-a148-e09fa7f9d844 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.576920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c533a0-36f1-43f0-a148-e09fa7f9d844 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.577676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c533a0-36f1-43f0-a148-e09fa7f9d844 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:01.577760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d1520-7fd1-49de-9788-5f020ed8bfd2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:01.578009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c533a0-36f1-43f0-a148-e09fa7f9d844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:01.579371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c533a0-36f1-43f0-a148-e09fa7f9d844 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:01.585661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 168/328] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:05:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:01.586417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d1520-7fd1-49de-9788-5f020ed8bfd2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:01.596578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 161/329] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:05:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:01.596578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c533a0-36f1-43f0-a148-e09fa7f9d844 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:01.627800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:01.687324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d1520-7fd1-49de-9788-5f020ed8bfd2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:01.695451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c533a0-36f1-43f0-a148-e09fa7f9d844 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:01.718135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:01.719846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bab8f-c929-4645-a2a9-830c53c1feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:01.720551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bab8f-c929-4645-a2a9-830c53c1feef None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.720860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bab8f-c929-4645-a2a9-830c53c1feef None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.721133 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bab8f-c929-4645-a2a9-830c53c1feef None admin] PATH_INFO: `/v3/groups` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.721820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bab8f-c929-4645-a2a9-830c53c1feef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:01.723283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bab8f-c929-4645-a2a9-830c53c1feef None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:01.732550 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7174f29-a808-422c-9ca3-e857d95bbaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:01.733936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7174f29-a808-422c-9ca3-e857d95bbaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.734368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7174f29-a808-422c-9ca3-e857d95bbaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.734780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7174f29-a808-422c-9ca3-e857d95bbaf1 None admin] PATH_INFO: `/v3/users/b0fa360ab2c042afb113099169ddae76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.736544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7174f29-a808-422c-9ca3-e857d95bbaf1 None admin] RBAC: Authorizing `identity:get_user(user_id=b0fa360ab2c042afb113099169ddae76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:01.738658 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 169/330] 10.222.0.27 () {60 vars in 1134 bytes} [Thu Jul 14 09:05:01 2022] POST /identity/v3/groups => generated 226 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:05:01.738933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7174f29-a808-422c-9ca3-e857d95bbaf1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:01.739452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bab8f-c929-4645-a2a9-830c53c1feef None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:01.741636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 162/331] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:05:01 2022] GET /identity/v3/users/b0fa360ab2c042afb113099169ddae76 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:01.749933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7174f29-a808-422c-9ca3-e857d95bbaf1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:01.865266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7174f29-a808-422c-9ca3-e857d95bbaf1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:01.877038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:01.880936 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bab8f-c929-4645-a2a9-830c53c1feef None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:01.905710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f2dd6-8fb5-4848-8d09-ef3e353cbeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:01.906376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f2dd6-8fb5-4848-8d09-ef3e353cbeea None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.906658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f2dd6-8fb5-4848-8d09-ef3e353cbeea None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.906934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f2dd6-8fb5-4848-8d09-ef3e353cbeea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.907774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f2dd6-8fb5-4848-8d09-ef3e353cbeea None admin] RBAC: Adding query filter params (role.id=1790dd5eeda1419ca41830c6448c63fe, user.id=b0fa360ab2c042afb113099169ddae76, scope.system=all) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:01.908082 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f2dd6-8fb5-4848-8d09-ef3e353cbeea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:01.909584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f2dd6-8fb5-4848-8d09-ef3e353cbeea None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:01.920892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca888a4-f00a-40d4-b9fb-43276ae667eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:01.921783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca888a4-f00a-40d4-b9fb-43276ae667eb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:01.922063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca888a4-f00a-40d4-b9fb-43276ae667eb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:01.922336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca888a4-f00a-40d4-b9fb-43276ae667eb None admin] PATH_INFO: `/v3/users/8084cd6c0ba7462bb832b1ae73dedef3` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:01.923782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca888a4-f00a-40d4-b9fb-43276ae667eb None admin] RBAC: Authorizing `identity:get_user(user_id=8084cd6c0ba7462bb832b1ae73dedef3)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:01.923887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 163/332] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jul 14 09:05:01 2022] GET /identity/v3/role_assignments?user.id=b0fa360ab2c042afb113099169ddae76&scope.system=all&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:01.925067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca888a4-f00a-40d4-b9fb-43276ae667eb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:01.926725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 170/333] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:05:01 2022] GET /identity/v3/users/8084cd6c0ba7462bb832b1ae73dedef3 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:01.932585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f2dd6-8fb5-4848-8d09-ef3e353cbeea None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:01.995581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:02.059815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f2dd6-8fb5-4848-8d09-ef3e353cbeea None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:02.098333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3fbac-f80f-49c4-a4c7-187a1d9f9d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:02.099232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3fbac-f80f-49c4-a4c7-187a1d9f9d57 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:02.099511 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3fbac-f80f-49c4-a4c7-187a1d9f9d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:02.099782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3fbac-f80f-49c4-a4c7-187a1d9f9d57 None admin] PATH_INFO: `/v3/system/users/8084cd6c0ba7462bb832b1ae73dedef3/roles/86fb57959e444c5ba2f9385f06d32865` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:02.101401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3fbac-f80f-49c4-a4c7-187a1d9f9d57 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8084cd6c0ba7462bb832b1ae73dedef3, role_id=86fb57959e444c5ba2f9385f06d32865)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:02.102817 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3fbac-f80f-49c4-a4c7-187a1d9f9d57 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:02.114394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 164/334] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Jul 14 09:05:01 2022] PUT /identity/v3/system/users/8084cd6c0ba7462bb832b1ae73dedef3/roles/86fb57959e444c5ba2f9385f06d32865 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:04.275680 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45b909-23dc-4f34-95f4-0b2d9a3c2051 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:04.276187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45b909-23dc-4f34-95f4-0b2d9a3c2051 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:04.276260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45b909-23dc-4f34-95f4-0b2d9a3c2051 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:04.278192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 171/335] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:04.283308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8bf7f-91a2-4505-a7fc-870cfac4aa27 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:04.283723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8bf7f-91a2-4505-a7fc-870cfac4aa27 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:04.283895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8bf7f-91a2-4505-a7fc-870cfac4aa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:04.302407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d0c8bf7f-91a2-4505-a7fc-870cfac4aa27 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:04.303600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d0c8bf7f-91a2-4505-a7fc-870cfac4aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:04.405805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 165/336] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:04.437332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45b909-23dc-4f34-95f4-0b2d9a3c2051 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:04.460709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23528-1b93-46b6-adb8-123699dd5a3b None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:04.461034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23528-1b93-46b6-adb8-123699dd5a3b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:04.461263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23528-1b93-46b6-adb8-123699dd5a3b None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:04.462900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 166/337] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:04.468015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29cc83-3ac5-4c9f-b9c9-d7dd8c18957a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:04.468300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29cc83-3ac5-4c9f-b9c9-d7dd8c18957a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:04.468579 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29cc83-3ac5-4c9f-b9c9-d7dd8c18957a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:04.495501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8f29cc83-3ac5-4c9f-b9c9-d7dd8c18957a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:04.499051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8f29cc83-3ac5-4c9f-b9c9-d7dd8c18957a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:04.557146 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:04.581114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 167/338] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:04.608159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29cc83-3ac5-4c9f-b9c9-d7dd8c18957a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:04.661362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45b909-23dc-4f34-95f4-0b2d9a3c2051 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:04.728620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29cc83-3ac5-4c9f-b9c9-d7dd8c18957a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:04.753353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9c495-5630-4a5b-92aa-bb88b2e5ebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:04.754439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9c495-5630-4a5b-92aa-bb88b2e5ebbd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:04.754867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9c495-5630-4a5b-92aa-bb88b2e5ebbd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:04.755379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9c495-5630-4a5b-92aa-bb88b2e5ebbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:04.768629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9c495-5630-4a5b-92aa-bb88b2e5ebbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:04.770437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ee55f-e441-42cb-833d-ab962a990c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:04.771260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee55f-e441-42cb-833d-ab962a990c20 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:04.771537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee55f-e441-42cb-833d-ab962a990c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:04.771810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee55f-e441-42cb-833d-ab962a990c20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-97e9c495-5630-4a5b-92aa-bb88b2e5ebbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:04.777746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:04.778889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:04.779729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:04.781940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 172/339] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:05:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:04.783413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837aae-96ad-491d-84ee-63b949663008 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:04.783757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ee55f-e441-42cb-833d-ab962a990c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:04.784021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837aae-96ad-491d-84ee-63b949663008 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:04.784440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837aae-96ad-491d-84ee-63b949663008 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:04.786118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 173/340] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:04.790908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28837aae-96ad-491d-84ee-63b949663008 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-284ee55f-e441-42cb-833d-ab962a990c20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:04.791964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:04.793395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:04.794342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 168/341] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:04.795579 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcfe27-dd65-471d-9d0d-ca870c7d6378 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:04.795867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcfe27-dd65-471d-9d0d-ca870c7d6378 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:04.796144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcfe27-dd65-471d-9d0d-ca870c7d6378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:04.821360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e1bcfe27-dd65-471d-9d0d-ca870c7d6378 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:04.822768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e1bcfe27-dd65-471d-9d0d-ca870c7d6378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:04.836790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:04.857463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:04.919474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 169/342] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:04.924976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcfe27-dd65-471d-9d0d-ca870c7d6378 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:04.938764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28837aae-96ad-491d-84ee-63b949663008 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:04.983380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ee0f5-dcdd-41b5-8381-f8ce72256e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:04.984314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ee0f5-dcdd-41b5-8381-f8ce72256e78 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:04.984774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ee0f5-dcdd-41b5-8381-f8ce72256e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:04.985471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ee0f5-dcdd-41b5-8381-f8ce72256e78 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:04.987292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ee0f5-dcdd-41b5-8381-f8ce72256e78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:04.987753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ee0f5-dcdd-41b5-8381-f8ce72256e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:04.989326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ee0f5-dcdd-41b5-8381-f8ce72256e78 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:05.001501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 174/343] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:05.002997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ee0f5-dcdd-41b5-8381-f8ce72256e78 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:05.064529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcfe27-dd65-471d-9d0d-ca870c7d6378 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:05.103421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ae21b-db2d-408f-ac4a-1fd0174c4440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:05.104437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae21b-db2d-408f-ac4a-1fd0174c4440 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.104917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae21b-db2d-408f-ac4a-1fd0174c4440 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.105360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae21b-db2d-408f-ac4a-1fd0174c4440 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.106301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ae21b-db2d-408f-ac4a-1fd0174c4440 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:05.106982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ae21b-db2d-408f-ac4a-1fd0174c4440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:05.108514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ae21b-db2d-408f-ac4a-1fd0174c4440 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:05.118313 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 170/344] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:05:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:05.119421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ae21b-db2d-408f-ac4a-1fd0174c4440 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:05.129244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:05.142393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ee0f5-dcdd-41b5-8381-f8ce72256e78 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:05.155339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:05.188158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ac07a-c0e2-4b5e-a7bb-19f0c3238e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:05.189010 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ac07a-c0e2-4b5e-a7bb-19f0c3238e43 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.189295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ac07a-c0e2-4b5e-a7bb-19f0c3238e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.189572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ac07a-c0e2-4b5e-a7bb-19f0c3238e43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.204578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ac07a-c0e2-4b5e-a7bb-19f0c3238e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-f27ac07a-c0e2-4b5e-a7bb-19f0c3238e43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:05.213644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:05.221559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 175/345] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:05.222903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e9da2-eb1c-4257-b07c-92cf984f5db1 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.224031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e9da2-eb1c-4257-b07c-92cf984f5db1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.224031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e9da2-eb1c-4257-b07c-92cf984f5db1 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.224031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 176/346] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:05.224031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e9da2-eb1c-4257-b07c-92cf984f5db1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:05.262873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ae21b-db2d-408f-ac4a-1fd0174c4440 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:05.303507 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff98d53-e6c7-494e-b520-1ac6b24c082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:05.304287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff98d53-e6c7-494e-b520-1ac6b24c082c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.304487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff98d53-e6c7-494e-b520-1ac6b24c082c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.304811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff98d53-e6c7-494e-b520-1ac6b24c082c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.341934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e9da2-eb1c-4257-b07c-92cf984f5db1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:05.376832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94769d-0ea4-4ba2-b37a-48ac5cf94b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:05.377648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94769d-0ea4-4ba2-b37a-48ac5cf94b83 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.377929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94769d-0ea4-4ba2-b37a-48ac5cf94b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.378204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94769d-0ea4-4ba2-b37a-48ac5cf94b83 None admin] PATH_INFO: `/v3/users/8084cd6c0ba7462bb832b1ae73dedef3` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.379428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94769d-0ea4-4ba2-b37a-48ac5cf94b83 None admin] RBAC: Authorizing `identity:get_user(user_id=8084cd6c0ba7462bb832b1ae73dedef3)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:05.383122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94769d-0ea4-4ba2-b37a-48ac5cf94b83 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:05.385163 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 177/347] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:05:05 2022] GET /identity/v3/users/8084cd6c0ba7462bb832b1ae73dedef3 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:05.386452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa257-de94-4449-ab45-ea4ab962c537 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.386746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa257-de94-4449-ab45-ea4ab962c537 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.387028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa257-de94-4449-ab45-ea4ab962c537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.389564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff98d53-e6c7-494e-b520-1ac6b24c082c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:05.391356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff98d53-e6c7-494e-b520-1ac6b24c082c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:05.404198 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ffafa257-de94-4449-ab45-ea4ab962c537 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:05.405454 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ffafa257-de94-4449-ab45-ea4ab962c537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:05.418532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:05.422183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:05.478850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 178/348] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:05.479420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa257-de94-4449-ab45-ea4ab962c537 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:05.501811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 171/349] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:05.502884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff98d53-e6c7-494e-b520-1ac6b24c082c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:05.603779 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa257-de94-4449-ab45-ea4ab962c537 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:05.625208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff98d53-e6c7-494e-b520-1ac6b24c082c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:05.652948 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:05.663984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c5e97-14be-494e-a175-4b90572fb161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:05.664647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c5e97-14be-494e-a175-4b90572fb161 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.664968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c5e97-14be-494e-a175-4b90572fb161 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.665244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c5e97-14be-494e-a175-4b90572fb161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.666091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c5e97-14be-494e-a175-4b90572fb161 None admin] RBAC: Adding query filter params (role.id=86fb57959e444c5ba2f9385f06d32865, user.id=8084cd6c0ba7462bb832b1ae73dedef3, scope.system=all) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:05.666401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c5e97-14be-494e-a175-4b90572fb161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:05.668764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c5e97-14be-494e-a175-4b90572fb161 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:05.673910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a7683-c5af-49a9-a90e-1b30ee5c225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:05.674602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a7683-c5af-49a9-a90e-1b30ee5c225a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.674893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a7683-c5af-49a9-a90e-1b30ee5c225a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.675168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a7683-c5af-49a9-a90e-1b30ee5c225a None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.675942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a7683-c5af-49a9-a90e-1b30ee5c225a None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:05.676249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a7683-c5af-49a9-a90e-1b30ee5c225a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:05.677655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a7683-c5af-49a9-a90e-1b30ee5c225a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:05.686960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 172/350] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jul 14 09:05:05 2022] GET /identity/v3/role_assignments?user.id=8084cd6c0ba7462bb832b1ae73dedef3&scope.system=all&role.id=86fb57959e444c5ba2f9385f06d32865 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:05.687976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c5e97-14be-494e-a175-4b90572fb161 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:05.694520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 179/351] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:05:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:05.695388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a7683-c5af-49a9-a90e-1b30ee5c225a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:05.717530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:05.823807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c5e97-14be-494e-a175-4b90572fb161 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:05.842052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a7683-c5af-49a9-a90e-1b30ee5c225a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:05.864619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31e720-3c26-4de9-9e99-553add53c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:05.865734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e720-3c26-4de9-9e99-553add53c645 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.866014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e720-3c26-4de9-9e99-553add53c645 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.866309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e720-3c26-4de9-9e99-553add53c645 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.867498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31e720-3c26-4de9-9e99-553add53c645 None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:05.869233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31e720-3c26-4de9-9e99-553add53c645 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:05.876041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 173/352] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:05 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:05.877596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf352794-8115-4767-83af-92bb10d041f7 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.877811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf352794-8115-4767-83af-92bb10d041f7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.878089 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf352794-8115-4767-83af-92bb10d041f7 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.879570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 174/353] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:05.880153 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf352794-8115-4767-83af-92bb10d041f7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:05.889838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c792a4-39ee-4c68-97a9-236b3993e1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:05.890648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c792a4-39ee-4c68-97a9-236b3993e1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:05.890923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c792a4-39ee-4c68-97a9-236b3993e1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:05.891189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c792a4-39ee-4c68-97a9-236b3993e1e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:05.903578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c792a4-39ee-4c68-97a9-236b3993e1e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d2c792a4-39ee-4c68-97a9-236b3993e1e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:05.914692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:05.916104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 180/354] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:05.918294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c792a4-39ee-4c68-97a9-236b3993e1e8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:05.968250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:06.022249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:06.036600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf352794-8115-4767-83af-92bb10d041f7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:06.057490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c792a4-39ee-4c68-97a9-236b3993e1e8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:06.085196 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb7beb-2a21-45fd-a584-34c2669365cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:06.085857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7beb-2a21-45fd-a584-34c2669365cb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:06.086139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7beb-2a21-45fd-a584-34c2669365cb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:06.086417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7beb-2a21-45fd-a584-34c2669365cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:06.102066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb2dd7-675a-4145-9b8d-d8138b1d72ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:06.102944 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb2dd7-675a-4145-9b8d-d8138b1d72ea None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:06.103256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb2dd7-675a-4145-9b8d-d8138b1d72ea None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:06.103533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb2dd7-675a-4145-9b8d-d8138b1d72ea None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:06.115949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb2dd7-675a-4145-9b8d-d8138b1d72ea None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:06.117514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb2dd7-675a-4145-9b8d-d8138b1d72ea None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:06.119406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 181/355] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:05 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:06.122676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef751b-851a-4d38-9a29-2e32231532f8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:06.122969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef751b-851a-4d38-9a29-2e32231532f8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:06.123414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef751b-851a-4d38-9a29-2e32231532f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:06.147582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-08ef751b-851a-4d38-9a29-2e32231532f8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:06.148859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-08ef751b-851a-4d38-9a29-2e32231532f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:06.178735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb7beb-2a21-45fd-a584-34c2669365cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:06.180100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb7beb-2a21-45fd-a584-34c2669365cb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:06.237696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 182/356] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:06.240119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef751b-851a-4d38-9a29-2e32231532f8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:06.247600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:06.320617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 175/357] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:06.322693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:06.325848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb7beb-2a21-45fd-a584-34c2669365cb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:06.373045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef751b-851a-4d38-9a29-2e32231532f8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:06.421208 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70310b-40d7-4224-bf6a-e2e8dc483d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:06.421881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70310b-40d7-4224-bf6a-e2e8dc483d42 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:06.422162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70310b-40d7-4224-bf6a-e2e8dc483d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:06.422433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70310b-40d7-4224-bf6a-e2e8dc483d42 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:06.423192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70310b-40d7-4224-bf6a-e2e8dc483d42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:06.423493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70310b-40d7-4224-bf6a-e2e8dc483d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:06.425520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70310b-40d7-4224-bf6a-e2e8dc483d42 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:06.435669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 183/358] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:05:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:06.436921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70310b-40d7-4224-bf6a-e2e8dc483d42 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:06.452975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb7beb-2a21-45fd-a584-34c2669365cb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:06.497177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758e3ae-6843-4607-8f2a-446bd4a23b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:06.497953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e3ae-6843-4607-8f2a-446bd4a23b31 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:06.498235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e3ae-6843-4607-8f2a-446bd4a23b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:06.498507 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e3ae-6843-4607-8f2a-446bd4a23b31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:06.499341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758e3ae-6843-4607-8f2a-446bd4a23b31 None admin] RBAC: Adding query filter params (group.id=d95c8d2da30c4ceba163b590b58aa1b0, role.id=45788771d2f1494a801cc09d365ff9e2, scope.project.id=b77ea42af6f745e0af87a131f9212231) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:06.499681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758e3ae-6843-4607-8f2a-446bd4a23b31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:06.501156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758e3ae-6843-4607-8f2a-446bd4a23b31 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:06.508150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 176/359] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jul 14 09:05:06 2022] GET /identity/v3/role_assignments?group.id=d95c8d2da30c4ceba163b590b58aa1b0&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=45788771d2f1494a801cc09d365ff9e2 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:06.509065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758e3ae-6843-4607-8f2a-446bd4a23b31 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:06.528339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:06.562713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70310b-40d7-4224-bf6a-e2e8dc483d42 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:06.595935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:06.608920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef44e7-cbb7-4654-95a6-2805c8cfefb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:06.609881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef44e7-cbb7-4654-95a6-2805c8cfefb1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:06.610167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef44e7-cbb7-4654-95a6-2805c8cfefb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:06.610440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef44e7-cbb7-4654-95a6-2805c8cfefb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:06.623094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef44e7-cbb7-4654-95a6-2805c8cfefb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c4ef44e7-cbb7-4654-95a6-2805c8cfefb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:06.631906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:06.633020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:06.633833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:06.638584 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 184/360] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:05:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:06.638741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758e3ae-6843-4607-8f2a-446bd4a23b31 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:06.639439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef44e7-cbb7-4654-95a6-2805c8cfefb1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:06.680250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed0d7a-26a5-44c5-96ab-ae817acf572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:06.681168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0d7a-26a5-44c5-96ab-ae817acf572c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:06.682610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0d7a-26a5-44c5-96ab-ae817acf572c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:06.682610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0d7a-26a5-44c5-96ab-ae817acf572c None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:06.683326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed0d7a-26a5-44c5-96ab-ae817acf572c None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:06.685216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed0d7a-26a5-44c5-96ab-ae817acf572c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:06.687047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 177/361] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:06 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:06.688212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a3fd9-205e-4448-8a7a-a063626cc4e0 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:06.688501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a3fd9-205e-4448-8a7a-a063626cc4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:06.691825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a3fd9-205e-4448-8a7a-a063626cc4e0 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:06.697628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 178/362] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:06.698658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a3fd9-205e-4448-8a7a-a063626cc4e0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:06.779632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef44e7-cbb7-4654-95a6-2805c8cfefb1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:06.799013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:06.828903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010d57e-077b-4456-a1da-f81ac7684b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:06.829576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d57e-077b-4456-a1da-f81ac7684b95 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:06.829861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d57e-077b-4456-a1da-f81ac7684b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:06.830135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d57e-077b-4456-a1da-f81ac7684b95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:06.833064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a3fd9-205e-4448-8a7a-a063626cc4e0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:06.878492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cf555-e445-4915-9d0a-b265874e8a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:06.879177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf555-e445-4915-9d0a-b265874e8a4d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:06.879463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf555-e445-4915-9d0a-b265874e8a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:06.879746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf555-e445-4915-9d0a-b265874e8a4d None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:06.880504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cf555-e445-4915-9d0a-b265874e8a4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:06.880868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cf555-e445-4915-9d0a-b265874e8a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:06.882359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cf555-e445-4915-9d0a-b265874e8a4d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:06.894003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 179/363] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:06.894856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cf555-e445-4915-9d0a-b265874e8a4d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:06.896723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:06.915289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010d57e-077b-4456-a1da-f81ac7684b95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:06.915939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010d57e-077b-4456-a1da-f81ac7684b95 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:07.024558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cf555-e445-4915-9d0a-b265874e8a4d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:07.039129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 185/364] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:07.040459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bbf26-d70d-41ad-8beb-ff47b1eb1ba1 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:07.040807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bbf26-d70d-41ad-8beb-ff47b1eb1ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:07.041053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bbf26-d70d-41ad-8beb-ff47b1eb1ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:07.061578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-669bbf26-d70d-41ad-8beb-ff47b1eb1ba1 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:07.063215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-669bbf26-d70d-41ad-8beb-ff47b1eb1ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:07.070770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c015c5-2026-4415-a0c1-450c9a399f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:07.071955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c015c5-2026-4415-a0c1-450c9a399f9c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:07.072237 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c015c5-2026-4415-a0c1-450c9a399f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:07.072507 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c015c5-2026-4415-a0c1-450c9a399f9c None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:07.074139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c015c5-2026-4415-a0c1-450c9a399f9c None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:07.076171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c015c5-2026-4415-a0c1-450c9a399f9c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:07.077924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 180/365] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:06 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:07.078777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c015c5-2026-4415-a0c1-450c9a399f9c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:07.097461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:07.151937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 186/366] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:07.153761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bbf26-d70d-41ad-8beb-ff47b1eb1ba1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:07.183917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:07.209978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c015c5-2026-4415-a0c1-450c9a399f9c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:07.251581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294c20-a4b8-4475-93e0-c4762dd042c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:07.252260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294c20-a4b8-4475-93e0-c4762dd042c5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:07.252516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294c20-a4b8-4475-93e0-c4762dd042c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:07.252825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294c20-a4b8-4475-93e0-c4762dd042c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:07.281937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bbf26-d70d-41ad-8beb-ff47b1eb1ba1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:07.328744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dd2e6-8cca-4c7a-b4a8-d03d415b28a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:07.329872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd2e6-8cca-4c7a-b4a8-d03d415b28a2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:07.330149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd2e6-8cca-4c7a-b4a8-d03d415b28a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:07.330420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd2e6-8cca-4c7a-b4a8-d03d415b28a2 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:07.331606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dd2e6-8cca-4c7a-b4a8-d03d415b28a2 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:07.333090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dd2e6-8cca-4c7a-b4a8-d03d415b28a2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:07.334993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 187/367] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:07 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:07.335752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dd2e6-8cca-4c7a-b4a8-d03d415b28a2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:07.342620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4294c20-a4b8-4475-93e0-c4762dd042c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:07.344101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4294c20-a4b8-4475-93e0-c4762dd042c5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:07.362221 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:07.435419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:07.459867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dd2e6-8cca-4c7a-b4a8-d03d415b28a2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:07.484261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 181/368] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:07.485173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294c20-a4b8-4475-93e0-c4762dd042c5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:07.512638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2147-70b1-4e3e-89ab-35eacdd93a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:07.513334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2147-70b1-4e3e-89ab-35eacdd93a12 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:07.513614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2147-70b1-4e3e-89ab-35eacdd93a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:07.513890 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2147-70b1-4e3e-89ab-35eacdd93a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:07.514727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2147-70b1-4e3e-89ab-35eacdd93a12 None admin] RBAC: Adding query filter params (group.id=d95c8d2da30c4ceba163b590b58aa1b0, role.id=1790dd5eeda1419ca41830c6448c63fe, scope.project.id=b77ea42af6f745e0af87a131f9212231) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:07.515035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2147-70b1-4e3e-89ab-35eacdd93a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:07.516601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2147-70b1-4e3e-89ab-35eacdd93a12 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:07.522328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 188/369] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jul 14 09:05:07 2022] GET /identity/v3/role_assignments?group.id=d95c8d2da30c4ceba163b590b58aa1b0&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:07.523115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2147-70b1-4e3e-89ab-35eacdd93a12 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:07.628200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294c20-a4b8-4475-93e0-c4762dd042c5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:07.648236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:07.662972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2147-70b1-4e3e-89ab-35eacdd93a12 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:07.688003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b700-5dad-4536-8cac-d35fdec82065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:07.689148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b700-5dad-4536-8cac-d35fdec82065 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:07.689475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b700-5dad-4536-8cac-d35fdec82065 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:07.689751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b700-5dad-4536-8cac-d35fdec82065 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:07.707403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b700-5dad-4536-8cac-d35fdec82065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-8758b700-5dad-4536-8cac-d35fdec82065 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:07.715933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:07.716955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:07.717792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 182/370] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:07.720370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99900fb7-ff5a-479c-b7ec-632851c5c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:07.721536 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b700-5dad-4536-8cac-d35fdec82065 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:07.721811 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99900fb7-ff5a-479c-b7ec-632851c5c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:07.722289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99900fb7-ff5a-479c-b7ec-632851c5c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:07.722759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99900fb7-ff5a-479c-b7ec-632851c5c8d9 None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:07.724162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99900fb7-ff5a-479c-b7ec-632851c5c8d9 None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:07.726310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99900fb7-ff5a-479c-b7ec-632851c5c8d9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:07.729318 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 189/371] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:07 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:07.734421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99900fb7-ff5a-479c-b7ec-632851c5c8d9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:07.757716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:07.850559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b700-5dad-4536-8cac-d35fdec82065 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:07.858234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99900fb7-ff5a-479c-b7ec-632851c5c8d9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:07.888310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0243a-6451-4ba2-b624-68b06b14c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:07.889187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0243a-6451-4ba2-b624-68b06b14c3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:07.889483 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0243a-6451-4ba2-b624-68b06b14c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:07.889785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0243a-6451-4ba2-b624-68b06b14c3a2 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:07.891009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0243a-6451-4ba2-b624-68b06b14c3a2 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:07.892440 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0243a-6451-4ba2-b624-68b06b14c3a2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:07.894464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 183/372] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:07 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:07.895097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0243a-6451-4ba2-b624-68b06b14c3a2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:07.903861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276656e-d087-459c-a2fa-8d9f0d1f0fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:07.904880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276656e-d087-459c-a2fa-8d9f0d1f0fcb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:07.905364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276656e-d087-459c-a2fa-8d9f0d1f0fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:07.905812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276656e-d087-459c-a2fa-8d9f0d1f0fcb None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:07.906748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276656e-d087-459c-a2fa-8d9f0d1f0fcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:07.907223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276656e-d087-459c-a2fa-8d9f0d1f0fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:07.908833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276656e-d087-459c-a2fa-8d9f0d1f0fcb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:07.919374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 190/373] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:07.920464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276656e-d087-459c-a2fa-8d9f0d1f0fcb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:07.946216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:08.020732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0243a-6451-4ba2-b624-68b06b14c3a2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:08.021631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:08.045188 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276656e-d087-459c-a2fa-8d9f0d1f0fcb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:08.056291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40454681-71ad-4535-bb2e-84a2de5e8e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:08.056981 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454681-71ad-4535-bb2e-84a2de5e8e28 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:08.057260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454681-71ad-4535-bb2e-84a2de5e8e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:08.057531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454681-71ad-4535-bb2e-84a2de5e8e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:08.058436 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454681-71ad-4535-bb2e-84a2de5e8e28 None admin] RBAC: Adding query filter params (group.id=d95c8d2da30c4ceba163b590b58aa1b0, role.id=1790dd5eeda1419ca41830c6448c63fe, scope.project.id=68adc705690343aca7cbb550db0fe39c) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:08.058728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454681-71ad-4535-bb2e-84a2de5e8e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:08.060164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454681-71ad-4535-bb2e-84a2de5e8e28 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:08.067035 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 184/374] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jul 14 09:05:07 2022] GET /identity/v3/role_assignments?group.id=d95c8d2da30c4ceba163b590b58aa1b0&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:08.067859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40454681-71ad-4535-bb2e-84a2de5e8e28 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:08.106255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b52fe9-ac68-47c5-ab47-b901da8b4397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:08.107160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b52fe9-ac68-47c5-ab47-b901da8b4397 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:08.107444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b52fe9-ac68-47c5-ab47-b901da8b4397 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:08.107718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b52fe9-ac68-47c5-ab47-b901da8b4397 None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:08.113617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b52fe9-ac68-47c5-ab47-b901da8b4397 None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:08.115101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b52fe9-ac68-47c5-ab47-b901da8b4397 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:08.117094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 191/375] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:07 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:08.123242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b52fe9-ac68-47c5-ab47-b901da8b4397 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:08.184742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40454681-71ad-4535-bb2e-84a2de5e8e28 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:08.187168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:08.226099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0f3c-91aa-46c3-97ef-7e4c5857f743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:08.226818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0f3c-91aa-46c3-97ef-7e4c5857f743 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:08.227102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0f3c-91aa-46c3-97ef-7e4c5857f743 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:08.227371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0f3c-91aa-46c3-97ef-7e4c5857f743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:08.287486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b52fe9-ac68-47c5-ab47-b901da8b4397 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:08.329720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92a689-6057-438d-8451-a0b36e70e68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:08.330527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92a689-6057-438d-8451-a0b36e70e68a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:08.330818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92a689-6057-438d-8451-a0b36e70e68a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:08.331255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92a689-6057-438d-8451-a0b36e70e68a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:08.332115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92a689-6057-438d-8451-a0b36e70e68a None admin] RBAC: Adding query filter params (group.id=d95c8d2da30c4ceba163b590b58aa1b0, role.id=45788771d2f1494a801cc09d365ff9e2, scope.project.id=68adc705690343aca7cbb550db0fe39c) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:08.332428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92a689-6057-438d-8451-a0b36e70e68a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:08.333927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92a689-6057-438d-8451-a0b36e70e68a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:08.341363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 192/376] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jul 14 09:05:08 2022] GET /identity/v3/role_assignments?group.id=d95c8d2da30c4ceba163b590b58aa1b0&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=45788771d2f1494a801cc09d365ff9e2 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:08.373722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d0f3c-91aa-46c3-97ef-7e4c5857f743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:08.375209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d0f3c-91aa-46c3-97ef-7e4c5857f743 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:08.534364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 185/377] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:08.539614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92a689-6057-438d-8451-a0b36e70e68a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:08.555962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:08.661676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92a689-6057-438d-8451-a0b36e70e68a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:08.697490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43225df-1eff-4f81-9578-4006b95a92ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:08.698369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43225df-1eff-4f81-9578-4006b95a92ff None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:08.698650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43225df-1eff-4f81-9578-4006b95a92ff None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:08.699024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43225df-1eff-4f81-9578-4006b95a92ff None admin] PATH_INFO: `/v3/projects/0f90549ec6704d3aa11b6699bd90eefe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:08.700903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43225df-1eff-4f81-9578-4006b95a92ff None admin] RBAC: Authorizing `identity:get_project(project_id=0f90549ec6704d3aa11b6699bd90eefe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:08.702349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43225df-1eff-4f81-9578-4006b95a92ff None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:08.704384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 193/378] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:08 2022] GET /identity/v3/projects/0f90549ec6704d3aa11b6699bd90eefe => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:08.709566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0f3c-91aa-46c3-97ef-7e4c5857f743 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:08.712849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:08.779550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db784-0828-42fa-a2a1-4dca20eab113 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:08.779921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db784-0828-42fa-a2a1-4dca20eab113 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:08.780106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db784-0828-42fa-a2a1-4dca20eab113 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:08.781659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 194/379] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:08.787550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2960-89fc-44ab-8cc9-14a8facc6b7c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:08.787845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2960-89fc-44ab-8cc9-14a8facc6b7c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:08.788144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2960-89fc-44ab-8cc9-14a8facc6b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:08.811254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-28cf2960-89fc-44ab-8cc9-14a8facc6b7c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:08.812473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-28cf2960-89fc-44ab-8cc9-14a8facc6b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:08.834931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0f3c-91aa-46c3-97ef-7e4c5857f743 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:08.882696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b871dc-4bda-4963-81b7-e2285e2a2ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:08.883670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b871dc-4bda-4963-81b7-e2285e2a2ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:08.883951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b871dc-4bda-4963-81b7-e2285e2a2ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:08.884224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b871dc-4bda-4963-81b7-e2285e2a2ae8 None admin] PATH_INFO: `/v3/groups/cafa0280f8304b5d93d7bf1e6d5c816d` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:08.895729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b871dc-4bda-4963-81b7-e2285e2a2ae8 None admin] RBAC: Authorizing `identity:get_group(group_id=cafa0280f8304b5d93d7bf1e6d5c816d)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:08.897422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b871dc-4bda-4963-81b7-e2285e2a2ae8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:08.899503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 195/381] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:08.899703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 186/381] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:08 2022] GET /identity/v3/groups/cafa0280f8304b5d93d7bf1e6d5c816d => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:08.905995 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf2960-89fc-44ab-8cc9-14a8facc6b7c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:08.918363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:08.926971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b871dc-4bda-4963-81b7-e2285e2a2ae8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:09.045993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:09.055876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf2960-89fc-44ab-8cc9-14a8facc6b7c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:09.100313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be1c2-58d6-4464-a33d-87d851a11852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:09.100641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be1c2-58d6-4464-a33d-87d851a11852 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:09.100940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be1c2-58d6-4464-a33d-87d851a11852 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:09.101363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be1c2-58d6-4464-a33d-87d851a11852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:09.102211 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be1c2-58d6-4464-a33d-87d851a11852 None admin] RBAC: Adding query filter params (group.id=cafa0280f8304b5d93d7bf1e6d5c816d, role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=0f90549ec6704d3aa11b6699bd90eefe) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:09.102519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be1c2-58d6-4464-a33d-87d851a11852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:09.104532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be1c2-58d6-4464-a33d-87d851a11852 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:09.114349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 196/382] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jul 14 09:05:08 2022] GET /identity/v3/role_assignments?group.id=cafa0280f8304b5d93d7bf1e6d5c816d&scope.project.id=0f90549ec6704d3aa11b6699bd90eefe&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:09.123107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b871dc-4bda-4963-81b7-e2285e2a2ae8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:09.164702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eacdc2-c578-4ea8-ade6-3fda12b49b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:09.165941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eacdc2-c578-4ea8-ade6-3fda12b49b78 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:09.166729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eacdc2-c578-4ea8-ade6-3fda12b49b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:09.167223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eacdc2-c578-4ea8-ade6-3fda12b49b78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:09.179107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eacdc2-c578-4ea8-ade6-3fda12b49b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-43eacdc2-c578-4ea8-ade6-3fda12b49b78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:09.188083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:09.189018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:09.189827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:09.192605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 187/383] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:05:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:09.201829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be1c2-58d6-4464-a33d-87d851a11852 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:09.288303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:09.327262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be1c2-58d6-4464-a33d-87d851a11852 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:09.371561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f6cf-9219-4f49-bb41-ca88358ba903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:09.372262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f6cf-9219-4f49-bb41-ca88358ba903 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:09.372546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f6cf-9219-4f49-bb41-ca88358ba903 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:09.372853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f6cf-9219-4f49-bb41-ca88358ba903 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:09.373621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479f6cf-9219-4f49-bb41-ca88358ba903 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:09.373924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479f6cf-9219-4f49-bb41-ca88358ba903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:09.375308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479f6cf-9219-4f49-bb41-ca88358ba903 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:09.385011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 197/384] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:09.390900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eacdc2-c578-4ea8-ade6-3fda12b49b78 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:09.509699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eacdc2-c578-4ea8-ade6-3fda12b49b78 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:09.545890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:09.556270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dec390-9664-4077-8cd0-cf99a02cfb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:09.557247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dec390-9664-4077-8cd0-cf99a02cfb52 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:09.557728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dec390-9664-4077-8cd0-cf99a02cfb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:09.558118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dec390-9664-4077-8cd0-cf99a02cfb52 None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:09.559361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dec390-9664-4077-8cd0-cf99a02cfb52 None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:09.560832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dec390-9664-4077-8cd0-cf99a02cfb52 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:09.562473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 188/385] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:09 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:09.568221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f6cf-9219-4f49-bb41-ca88358ba903 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:09.696147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f6cf-9219-4f49-bb41-ca88358ba903 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:09.738226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f642ad2-1eac-423b-96b7-599bc25f2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:09.739097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642ad2-1eac-423b-96b7-599bc25f2841 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:09.739381 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642ad2-1eac-423b-96b7-599bc25f2841 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:09.739655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642ad2-1eac-423b-96b7-599bc25f2841 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:09.740885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f642ad2-1eac-423b-96b7-599bc25f2841 None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:09.742485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f642ad2-1eac-423b-96b7-599bc25f2841 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:09.744529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 198/386] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:09 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:09.750248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dec390-9664-4077-8cd0-cf99a02cfb52 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:09.870331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dec390-9664-4077-8cd0-cf99a02cfb52 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:09.905218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66433b7-0881-42d7-bc68-31034d418fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:09.906110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66433b7-0881-42d7-bc68-31034d418fb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:09.906394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66433b7-0881-42d7-bc68-31034d418fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:09.906671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66433b7-0881-42d7-bc68-31034d418fb9 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231/groups/d95c8d2da30c4ceba163b590b58aa1b0/roles/45788771d2f1494a801cc09d365ff9e2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:09.908931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66433b7-0881-42d7-bc68-31034d418fb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ea42af6f745e0af87a131f9212231, group_id=d95c8d2da30c4ceba163b590b58aa1b0, role_id=45788771d2f1494a801cc09d365ff9e2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:09.910378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66433b7-0881-42d7-bc68-31034d418fb9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:09.925383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 189/387] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jul 14 09:05:09 2022] PUT /identity/v3/projects/b77ea42af6f745e0af87a131f9212231/groups/d95c8d2da30c4ceba163b590b58aa1b0/roles/45788771d2f1494a801cc09d365ff9e2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:05:10.078263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fe11c-bb7a-48b5-a619-4581743a028d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:10.078815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fe11c-bb7a-48b5-a619-4581743a028d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:10.079203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fe11c-bb7a-48b5-a619-4581743a028d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:10.081189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 199/388] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:10.087046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cb76-15d3-4c6a-8757-4d63228685ca None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:10.087380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cb76-15d3-4c6a-8757-4d63228685ca None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:10.087604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cb76-15d3-4c6a-8757-4d63228685ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:10.109918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2001cb76-15d3-4c6a-8757-4d63228685ca None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:10.111157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2001cb76-15d3-4c6a-8757-4d63228685ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:10.172923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:10.196676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 190/389] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:10.223019 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fe11c-bb7a-48b5-a619-4581743a028d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:10.227103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:10.377544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fe11c-bb7a-48b5-a619-4581743a028d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:10.426238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08814be-1b2e-42ad-94e2-e58aac302804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:10.427049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08814be-1b2e-42ad-94e2-e58aac302804 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:10.427328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08814be-1b2e-42ad-94e2-e58aac302804 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:10.427596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08814be-1b2e-42ad-94e2-e58aac302804 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:10.442785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08814be-1b2e-42ad-94e2-e58aac302804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-a08814be-1b2e-42ad-94e2-e58aac302804 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:10.450935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:10.451868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:10.453161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 200/390] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:10.460209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cb76-15d3-4c6a-8757-4d63228685ca None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:10.631602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cb76-15d3-4c6a-8757-4d63228685ca None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:10.669387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b26abf-63ef-46b9-84eb-b1ac25038a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:10.670065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b26abf-63ef-46b9-84eb-b1ac25038a0c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:10.670347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b26abf-63ef-46b9-84eb-b1ac25038a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:10.670622 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b26abf-63ef-46b9-84eb-b1ac25038a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:10.671444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b26abf-63ef-46b9-84eb-b1ac25038a0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:10.671749 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b26abf-63ef-46b9-84eb-b1ac25038a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:10.673218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b26abf-63ef-46b9-84eb-b1ac25038a0c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:10.682264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 191/391] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:05:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:10.687970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08814be-1b2e-42ad-94e2-e58aac302804 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:10.791925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:10.838531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08814be-1b2e-42ad-94e2-e58aac302804 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:10.870591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37616a-7997-4469-98fe-3ec9f49ebc02 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:10.871386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37616a-7997-4469-98fe-3ec9f49ebc02 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:10.871676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37616a-7997-4469-98fe-3ec9f49ebc02 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:10.873418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 192/392] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:10.878727 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baffc5b-afe6-4dcb-895e-35c1f45c14c6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:10.879016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baffc5b-afe6-4dcb-895e-35c1f45c14c6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:10.879292 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baffc5b-afe6-4dcb-895e-35c1f45c14c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:10.880176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e29982-00a8-4420-8e9c-aa997ab2b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:10.881077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29982-00a8-4420-8e9c-aa997ab2b16f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:10.881460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29982-00a8-4420-8e9c-aa997ab2b16f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:10.881790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29982-00a8-4420-8e9c-aa997ab2b16f None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:10.883612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e29982-00a8-4420-8e9c-aa997ab2b16f None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:10.885623 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e29982-00a8-4420-8e9c-aa997ab2b16f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:10.888815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 201/393] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:10 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:10.893294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e29982-00a8-4420-8e9c-aa997ab2b16f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:10.921657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6baffc5b-afe6-4dcb-895e-35c1f45c14c6 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:10.922856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6baffc5b-afe6-4dcb-895e-35c1f45c14c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:11.017616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 193/394] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:11.017940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:11.049256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e29982-00a8-4420-8e9c-aa997ab2b16f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:11.061712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baffc5b-afe6-4dcb-895e-35c1f45c14c6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:11.100219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:11.110477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06874f5-c831-4bf8-87bd-ff2076c3d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:11.111654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06874f5-c831-4bf8-87bd-ff2076c3d8db None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:11.112139 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06874f5-c831-4bf8-87bd-ff2076c3d8db None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:11.112641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06874f5-c831-4bf8-87bd-ff2076c3d8db None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:11.113962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06874f5-c831-4bf8-87bd-ff2076c3d8db None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:11.115602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06874f5-c831-4bf8-87bd-ff2076c3d8db None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:11.117796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 202/395] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:10 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:11.119175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6928-1f9c-43f3-b179-6764a25a974b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:11.119647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6928-1f9c-43f3-b179-6764a25a974b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:11.120073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6928-1f9c-43f3-b179-6764a25a974b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:11.122239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 203/396] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:11.127523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a6928-1f9c-43f3-b179-6764a25a974b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:11.195952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baffc5b-afe6-4dcb-895e-35c1f45c14c6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:11.232227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22073912-5b2c-428f-a2af-e775069fdaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:11.233497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22073912-5b2c-428f-a2af-e775069fdaca None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:11.234004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22073912-5b2c-428f-a2af-e775069fdaca None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:11.234471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22073912-5b2c-428f-a2af-e775069fdaca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:11.244937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a6928-1f9c-43f3-b179-6764a25a974b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:11.246668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22073912-5b2c-428f-a2af-e775069fdaca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-22073912-5b2c-428f-a2af-e775069fdaca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:11.254572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:11.255457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:11.256255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:11.258894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 194/397] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:11.260342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84387997-599e-4969-bcbd-bb847ebc69ee None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:11.260950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84387997-599e-4969-bcbd-bb847ebc69ee None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:11.261446 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84387997-599e-4969-bcbd-bb847ebc69ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:11.278170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-84387997-599e-4969-bcbd-bb847ebc69ee None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:11.279729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-84387997-599e-4969-bcbd-bb847ebc69ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:11.282403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4674c-cc70-4c29-8424-3d6bebe3d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:11.283342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4674c-cc70-4c29-8424-3d6bebe3d87a None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:11.283668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4674c-cc70-4c29-8424-3d6bebe3d87a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:11.283931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4674c-cc70-4c29-8424-3d6bebe3d87a None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231/groups/d95c8d2da30c4ceba163b590b58aa1b0/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:11.286014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4674c-cc70-4c29-8424-3d6bebe3d87a None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ea42af6f745e0af87a131f9212231, group_id=d95c8d2da30c4ceba163b590b58aa1b0, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:11.287515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4674c-cc70-4c29-8424-3d6bebe3d87a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:11.303926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 204/398] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jul 14 09:05:11 2022] PUT /identity/v3/projects/b77ea42af6f745e0af87a131f9212231/groups/d95c8d2da30c4ceba163b590b58aa1b0/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:05:11.304877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4674c-cc70-4c29-8424-3d6bebe3d87a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:11.317477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:11.370338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 195/399] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:11.414386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84387997-599e-4969-bcbd-bb847ebc69ee None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:11.432345 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:11.500352 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4674c-cc70-4c29-8424-3d6bebe3d87a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:11.545771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84387997-599e-4969-bcbd-bb847ebc69ee None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:11.555356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799ea4f-86b4-4384-8669-bdcff8da5702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:11.556037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799ea4f-86b4-4384-8669-bdcff8da5702 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:11.556319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799ea4f-86b4-4384-8669-bdcff8da5702 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:11.556590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799ea4f-86b4-4384-8669-bdcff8da5702 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:11.557384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799ea4f-86b4-4384-8669-bdcff8da5702 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:11.558458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799ea4f-86b4-4384-8669-bdcff8da5702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:11.560310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799ea4f-86b4-4384-8669-bdcff8da5702 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:11.572382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 205/400] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:05:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:11.578442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799ea4f-86b4-4384-8669-bdcff8da5702 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:11.596645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aca00-b86e-431c-8dcd-3e6ed441d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:11.597675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aca00-b86e-431c-8dcd-3e6ed441d7dc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:11.598009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aca00-b86e-431c-8dcd-3e6ed441d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:11.598288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aca00-b86e-431c-8dcd-3e6ed441d7dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:11.613189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6aca00-b86e-431c-8dcd-3e6ed441d7dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3e6aca00-b86e-431c-8dcd-3e6ed441d7dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:11.623518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:11.624447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:11.625294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 196/401] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:05:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:11.631669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aca00-b86e-431c-8dcd-3e6ed441d7dc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:11.676026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:11.704675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799ea4f-86b4-4384-8669-bdcff8da5702 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:11.727254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:11.750787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca6710-c455-4948-88e3-bc8d2713ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:11.751592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6710-c455-4948-88e3-bc8d2713ba83 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:11.751880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6710-c455-4948-88e3-bc8d2713ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:11.752156 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca6710-c455-4948-88e3-bc8d2713ba83 None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:11.754053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca6710-c455-4948-88e3-bc8d2713ba83 None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:11.755492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca6710-c455-4948-88e3-bc8d2713ba83 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:11.764841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 206/402] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:11 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:11.779229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca6710-c455-4948-88e3-bc8d2713ba83 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:11.827369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aca00-b86e-431c-8dcd-3e6ed441d7dc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:11.891169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851daa4e-f5e5-4784-aa90-8a23384f7b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:11.892922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851daa4e-f5e5-4784-aa90-8a23384f7b05 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:11.893907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851daa4e-f5e5-4784-aa90-8a23384f7b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:11.895074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851daa4e-f5e5-4784-aa90-8a23384f7b05 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:11.896592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851daa4e-f5e5-4784-aa90-8a23384f7b05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:11.897136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851daa4e-f5e5-4784-aa90-8a23384f7b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:11.898738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851daa4e-f5e5-4784-aa90-8a23384f7b05 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:11.909969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 197/403] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:11.915266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851daa4e-f5e5-4784-aa90-8a23384f7b05 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:11.961477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca6710-c455-4948-88e3-bc8d2713ba83 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:11.999130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c689bb3-98b5-4912-9d4c-4717225957f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:12.000308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c689bb3-98b5-4912-9d4c-4717225957f8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.000848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c689bb3-98b5-4912-9d4c-4717225957f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.001305 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c689bb3-98b5-4912-9d4c-4717225957f8 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.002664 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c689bb3-98b5-4912-9d4c-4717225957f8 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:12.004293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c689bb3-98b5-4912-9d4c-4717225957f8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:12.006424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 207/404] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:11 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:12.007762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b1268-e2f1-48e8-a22c-7ebd6250b7d5 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.008141 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b1268-e2f1-48e8-a22c-7ebd6250b7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.008482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b1268-e2f1-48e8-a22c-7ebd6250b7d5 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.011762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 208/405] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:12.016522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b1268-e2f1-48e8-a22c-7ebd6250b7d5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:12.042902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:12.057262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851daa4e-f5e5-4784-aa90-8a23384f7b05 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:12.082633 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:12.103866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e147d36-97a5-4045-b929-31c7ae13823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:12.105168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147d36-97a5-4045-b929-31c7ae13823d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.105630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147d36-97a5-4045-b929-31c7ae13823d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.106578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147d36-97a5-4045-b929-31c7ae13823d None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.108352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e147d36-97a5-4045-b929-31c7ae13823d None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:12.110519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e147d36-97a5-4045-b929-31c7ae13823d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:12.113415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 198/406] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:11 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:12.115364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ac518-77d5-4935-8b0a-03a3197b2f52 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.115848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ac518-77d5-4935-8b0a-03a3197b2f52 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.116301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ac518-77d5-4935-8b0a-03a3197b2f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.135802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-088ac518-77d5-4935-8b0a-03a3197b2f52 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:12.137161 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-088ac518-77d5-4935-8b0a-03a3197b2f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:12.139540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b1268-e2f1-48e8-a22c-7ebd6250b7d5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:12.177029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76097e4-e2ac-4fc6-b632-ed9e65cb78e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:12.178017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76097e4-e2ac-4fc6-b632-ed9e65cb78e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.178351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76097e4-e2ac-4fc6-b632-ed9e65cb78e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.178673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76097e4-e2ac-4fc6-b632-ed9e65cb78e6 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c/groups/d95c8d2da30c4ceba163b590b58aa1b0/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.180827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76097e4-e2ac-4fc6-b632-ed9e65cb78e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=68adc705690343aca7cbb550db0fe39c, group_id=d95c8d2da30c4ceba163b590b58aa1b0, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:12.182549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76097e4-e2ac-4fc6-b632-ed9e65cb78e6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:12.205495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 209/407] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jul 14 09:05:12 2022] PUT /identity/v3/projects/68adc705690343aca7cbb550db0fe39c/groups/d95c8d2da30c4ceba163b590b58aa1b0/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:12.205495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76097e4-e2ac-4fc6-b632-ed9e65cb78e6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:12.237447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 199/408] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:12.258004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ac518-77d5-4935-8b0a-03a3197b2f52 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:12.417119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76097e4-e2ac-4fc6-b632-ed9e65cb78e6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:12.423046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:12.436875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:12.442089 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ac518-77d5-4935-8b0a-03a3197b2f52 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:12.469149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156b64-74dd-4085-a927-401f7924b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:12.470284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156b64-74dd-4085-a927-401f7924b378 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.470568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156b64-74dd-4085-a927-401f7924b378 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.470846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156b64-74dd-4085-a927-401f7924b378 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.472742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156b64-74dd-4085-a927-401f7924b378 None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:12.474815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156b64-74dd-4085-a927-401f7924b378 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:12.477378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 210/409] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:12 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:12.481182 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97978af-83d6-460a-8f4f-b2da753e38b3 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.481636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97978af-83d6-460a-8f4f-b2da753e38b3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.482057 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97978af-83d6-460a-8f4f-b2da753e38b3 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.483579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 211/410] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:12.484582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97978af-83d6-460a-8f4f-b2da753e38b3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:12.489604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d8f48-7eda-44ef-8c50-4218710c72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:12.490409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d8f48-7eda-44ef-8c50-4218710c72fc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.490687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d8f48-7eda-44ef-8c50-4218710c72fc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.490978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d8f48-7eda-44ef-8c50-4218710c72fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.506273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d8f48-7eda-44ef-8c50-4218710c72fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-148d8f48-7eda-44ef-8c50-4218710c72fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:12.515262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:12.516253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:12.517404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:12.520006 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 200/411] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:12.521524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec790d2-7687-46e2-b6a4-1413262c44a3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.522041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec790d2-7687-46e2-b6a4-1413262c44a3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.522523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec790d2-7687-46e2-b6a4-1413262c44a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.541137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-dec790d2-7687-46e2-b6a4-1413262c44a3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:12.542857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dec790d2-7687-46e2-b6a4-1413262c44a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:12.623656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97978af-83d6-460a-8f4f-b2da753e38b3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:12.624004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 201/412] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:12.625469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec790d2-7687-46e2-b6a4-1413262c44a3 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:12.663572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90714f6-f65b-46f6-978b-f4168dbc1927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:12.664893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90714f6-f65b-46f6-978b-f4168dbc1927 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.665403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90714f6-f65b-46f6-978b-f4168dbc1927 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.666242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90714f6-f65b-46f6-978b-f4168dbc1927 None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c/groups/d95c8d2da30c4ceba163b590b58aa1b0/roles/45788771d2f1494a801cc09d365ff9e2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.668952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90714f6-f65b-46f6-978b-f4168dbc1927 None admin] RBAC: Authorizing `identity:create_grant(project_id=68adc705690343aca7cbb550db0fe39c, group_id=d95c8d2da30c4ceba163b590b58aa1b0, role_id=45788771d2f1494a801cc09d365ff9e2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:12.670613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90714f6-f65b-46f6-978b-f4168dbc1927 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:12.692754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 212/413] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jul 14 09:05:12 2022] PUT /identity/v3/projects/68adc705690343aca7cbb550db0fe39c/groups/d95c8d2da30c4ceba163b590b58aa1b0/roles/45788771d2f1494a801cc09d365ff9e2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:12.694607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90714f6-f65b-46f6-978b-f4168dbc1927 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:12.757591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:12.785183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:12.801043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec790d2-7687-46e2-b6a4-1413262c44a3 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:12.849012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02242c14-a506-4e53-bf60-fd08321b7357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:12.849794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242c14-a506-4e53-bf60-fd08321b7357 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.850177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242c14-a506-4e53-bf60-fd08321b7357 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.850455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242c14-a506-4e53-bf60-fd08321b7357 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.851223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02242c14-a506-4e53-bf60-fd08321b7357 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:12.851527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02242c14-a506-4e53-bf60-fd08321b7357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:12.852929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90714f6-f65b-46f6-978b-f4168dbc1927 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:12.853041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02242c14-a506-4e53-bf60-fd08321b7357 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:12.863332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 202/414] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:12.868880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02242c14-a506-4e53-bf60-fd08321b7357 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:12.898111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ee467-0046-4979-8ed5-7b4245c74d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:12.898990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ee467-0046-4979-8ed5-7b4245c74d4d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:12.899270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ee467-0046-4979-8ed5-7b4245c74d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:12.899538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ee467-0046-4979-8ed5-7b4245c74d4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:12.910640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ee467-0046-4979-8ed5-7b4245c74d4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-113ee467-0046-4979-8ed5-7b4245c74d4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:12.919238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:12.920366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:12.921228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:12.921848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 213/415] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:05:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:12.928534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ee467-0046-4979-8ed5-7b4245c74d4d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:12.987364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02242c14-a506-4e53-bf60-fd08321b7357 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:13.038407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606b53e-7ad1-46d7-92aa-65023e2bba30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:13.039429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606b53e-7ad1-46d7-92aa-65023e2bba30 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:13.039713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606b53e-7ad1-46d7-92aa-65023e2bba30 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:13.039989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606b53e-7ad1-46d7-92aa-65023e2bba30 None admin] PATH_INFO: `/v3/groups/cafa0280f8304b5d93d7bf1e6d5c816d` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:13.045589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606b53e-7ad1-46d7-92aa-65023e2bba30 None admin] RBAC: Authorizing `identity:get_group(group_id=cafa0280f8304b5d93d7bf1e6d5c816d)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:13.047065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606b53e-7ad1-46d7-92aa-65023e2bba30 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:13.049039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 203/416] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:12 2022] GET /identity/v3/groups/cafa0280f8304b5d93d7bf1e6d5c816d => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:13.051367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ee467-0046-4979-8ed5-7b4245c74d4d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:13.054166 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:13.055479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606b53e-7ad1-46d7-92aa-65023e2bba30 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:13.076997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:13.091097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1d41-d7a8-482b-bc3e-c05bbdfd9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:13.092169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1d41-d7a8-482b-bc3e-c05bbdfd9da3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:13.092455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1d41-d7a8-482b-bc3e-c05bbdfd9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:13.092892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1d41-d7a8-482b-bc3e-c05bbdfd9da3 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:13.093862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb1d41-d7a8-482b-bc3e-c05bbdfd9da3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:13.094176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb1d41-d7a8-482b-bc3e-c05bbdfd9da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:13.095551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb1d41-d7a8-482b-bc3e-c05bbdfd9da3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:13.106119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 214/417] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:13.111774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1d41-d7a8-482b-bc3e-c05bbdfd9da3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:13.217887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1d41-d7a8-482b-bc3e-c05bbdfd9da3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:13.254002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606b53e-7ad1-46d7-92aa-65023e2bba30 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:13.278301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a363d-6caa-459f-9c55-b8e7186a6f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:13.279016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a363d-6caa-459f-9c55-b8e7186a6f00 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:13.279300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a363d-6caa-459f-9c55-b8e7186a6f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:13.279574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a363d-6caa-459f-9c55-b8e7186a6f00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:13.297420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489f0f1-e975-4c71-bef8-2af1f75e3977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:13.298223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489f0f1-e975-4c71-bef8-2af1f75e3977 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:13.298504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489f0f1-e975-4c71-bef8-2af1f75e3977 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:13.298777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489f0f1-e975-4c71-bef8-2af1f75e3977 None admin] PATH_INFO: `/v3/projects/0f90549ec6704d3aa11b6699bd90eefe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:13.301607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489f0f1-e975-4c71-bef8-2af1f75e3977 None admin] RBAC: Authorizing `identity:get_project(project_id=0f90549ec6704d3aa11b6699bd90eefe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:13.303059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489f0f1-e975-4c71-bef8-2af1f75e3977 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:13.306416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 204/418] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:13 2022] GET /identity/v3/projects/0f90549ec6704d3aa11b6699bd90eefe => generated 344 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:13.310407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489f0f1-e975-4c71-bef8-2af1f75e3977 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:13.354713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:13.422141 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a363d-6caa-459f-9c55-b8e7186a6f00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:13.423618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a363d-6caa-459f-9c55-b8e7186a6f00 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:13.463424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:13.504340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489f0f1-e975-4c71-bef8-2af1f75e3977 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:13.535342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 215/419] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:05:13.542370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a363d-6caa-459f-9c55-b8e7186a6f00 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:13.601484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1399588-b313-43b5-b624-021ae760b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:13.602317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1399588-b313-43b5-b624-021ae760b391 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:13.602602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1399588-b313-43b5-b624-021ae760b391 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:13.602878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1399588-b313-43b5-b624-021ae760b391 None admin] PATH_INFO: `/v3/projects/0f90549ec6704d3aa11b6699bd90eefe/groups/cafa0280f8304b5d93d7bf1e6d5c816d/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:13.605520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1399588-b313-43b5-b624-021ae760b391 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f90549ec6704d3aa11b6699bd90eefe, group_id=cafa0280f8304b5d93d7bf1e6d5c816d, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:13.607013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1399588-b313-43b5-b624-021ae760b391 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:13.610781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:13.634603 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 205/420] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jul 14 09:05:13 2022] PUT /identity/v3/projects/0f90549ec6704d3aa11b6699bd90eefe/groups/cafa0280f8304b5d93d7bf1e6d5c816d/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:13.651030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a363d-6caa-459f-9c55-b8e7186a6f00 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:13.689715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51485422-02cc-4ec6-aedb-4ae442a7c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:13.690598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51485422-02cc-4ec6-aedb-4ae442a7c343 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:13.690881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51485422-02cc-4ec6-aedb-4ae442a7c343 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:13.691153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51485422-02cc-4ec6-aedb-4ae442a7c343 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:13.692650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51485422-02cc-4ec6-aedb-4ae442a7c343 None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:13.694163 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51485422-02cc-4ec6-aedb-4ae442a7c343 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:13.696344 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 216/421] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:13 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:13.702208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1399588-b313-43b5-b624-021ae760b391 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:13.816781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1399588-b313-43b5-b624-021ae760b391 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:13.856352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2e5d7-7cad-4070-bb60-cd0571873561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:13.857191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2e5d7-7cad-4070-bb60-cd0571873561 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:13.857480 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2e5d7-7cad-4070-bb60-cd0571873561 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:13.857761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2e5d7-7cad-4070-bb60-cd0571873561 None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:13.858958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2e5d7-7cad-4070-bb60-cd0571873561 None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:13.860418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2e5d7-7cad-4070-bb60-cd0571873561 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:13.862435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 206/422] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:13 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:13.868084 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51485422-02cc-4ec6-aedb-4ae442a7c343 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:13.873429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e511-7f28-4dd6-bcd8-fee93cf99d79 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:13.873715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e511-7f28-4dd6-bcd8-fee93cf99d79 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:13.873993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e511-7f28-4dd6-bcd8-fee93cf99d79 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:13.875610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 207/423] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:13.880747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc3c0d-fe61-468f-a771-8600b79a4673 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:13.881034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc3c0d-fe61-468f-a771-8600b79a4673 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:13.881306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc3c0d-fe61-468f-a771-8600b79a4673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:13.889023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:13.907667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d5dc3c0d-fe61-468f-a771-8600b79a4673 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:13.909248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d5dc3c0d-fe61-468f-a771-8600b79a4673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:13.998744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51485422-02cc-4ec6-aedb-4ae442a7c343 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:14.011384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 208/424] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:14.034512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4274bd2-c23d-4b54-8310-5242cb2ad063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:14.035232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4274bd2-c23d-4b54-8310-5242cb2ad063 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:14.035567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4274bd2-c23d-4b54-8310-5242cb2ad063 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:14.035843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4274bd2-c23d-4b54-8310-5242cb2ad063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:14.036692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4274bd2-c23d-4b54-8310-5242cb2ad063 None admin] RBAC: Adding query filter params (group.id=d95c8d2da30c4ceba163b590b58aa1b0, role.id=45788771d2f1494a801cc09d365ff9e2, scope.project.id=b77ea42af6f745e0af87a131f9212231) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:14.037137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4274bd2-c23d-4b54-8310-5242cb2ad063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:14.038651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4274bd2-c23d-4b54-8310-5242cb2ad063 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:14.040999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:14.046129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 217/425] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jul 14 09:05:13 2022] GET /identity/v3/role_assignments?group.id=d95c8d2da30c4ceba163b590b58aa1b0&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=45788771d2f1494a801cc09d365ff9e2 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:14.048648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc3c0d-fe61-468f-a771-8600b79a4673 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:14.213819 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc3c0d-fe61-468f-a771-8600b79a4673 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:14.260546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d952c3f-5988-4650-a794-1a8209cf86e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:14.261891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d952c3f-5988-4650-a794-1a8209cf86e4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:14.262176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d952c3f-5988-4650-a794-1a8209cf86e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:14.262448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d952c3f-5988-4650-a794-1a8209cf86e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:14.265839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:14.277583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d952c3f-5988-4650-a794-1a8209cf86e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-7d952c3f-5988-4650-a794-1a8209cf86e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:14.285544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:14.286563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:14.287365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 209/426] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:14.293701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4274bd2-c23d-4b54-8310-5242cb2ad063 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:14.418047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4274bd2-c23d-4b54-8310-5242cb2ad063 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:14.459748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36c1de-5ace-4468-be98-1c2fc3365dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:14.460436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c1de-5ace-4468-be98-1c2fc3365dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:14.460791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c1de-5ace-4468-be98-1c2fc3365dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:14.461079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c1de-5ace-4468-be98-1c2fc3365dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:14.462021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c1de-5ace-4468-be98-1c2fc3365dc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:14.462339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c1de-5ace-4468-be98-1c2fc3365dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:14.463965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c1de-5ace-4468-be98-1c2fc3365dc4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:14.473468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 218/427] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:05:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:14.478995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d952c3f-5988-4650-a794-1a8209cf86e4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:14.580580 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d952c3f-5988-4650-a794-1a8209cf86e4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:14.614850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592c3f8-9ef7-4589-8fb4-c86e801dc542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:14.615870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c3f8-9ef7-4589-8fb4-c86e801dc542 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:14.616368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c3f8-9ef7-4589-8fb4-c86e801dc542 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:14.616852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c3f8-9ef7-4589-8fb4-c86e801dc542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:14.628239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf20611-2ffd-43eb-b049-448ae164f09b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:14.628553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf20611-2ffd-43eb-b049-448ae164f09b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:14.628863 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf20611-2ffd-43eb-b049-448ae164f09b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:14.630375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 219/428] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:14.635848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda82f71-76ff-4575-90f3-74457f7073ee None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:14.635848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda82f71-76ff-4575-90f3-74457f7073ee None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:14.636156 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda82f71-76ff-4575-90f3-74457f7073ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:14.656816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-fda82f71-76ff-4575-90f3-74457f7073ee None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:14.658924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fda82f71-76ff-4575-90f3-74457f7073ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:14.686135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:14.696552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592c3f8-9ef7-4589-8fb4-c86e801dc542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:14.698916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592c3f8-9ef7-4589-8fb4-c86e801dc542 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:14.734523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:14.753808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 220/429] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:14.779859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda82f71-76ff-4575-90f3-74457f7073ee None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:14.816490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 210/430] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:14.821615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592c3f8-9ef7-4589-8fb4-c86e801dc542 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:14.884090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda82f71-76ff-4575-90f3-74457f7073ee None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:14.921369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b2d54-8b7a-4b1d-9847-4b31dde92396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:14.922086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:14.923128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2d54-8b7a-4b1d-9847-4b31dde92396 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:14.923603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2d54-8b7a-4b1d-9847-4b31dde92396 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:14.924070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2d54-8b7a-4b1d-9847-4b31dde92396 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:14.929538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592c3f8-9ef7-4589-8fb4-c86e801dc542 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:14.937672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b2d54-8b7a-4b1d-9847-4b31dde92396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-6c8b2d54-8b7a-4b1d-9847-4b31dde92396 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:14.948103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:14.949250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:05:14.950050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:14.952731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 221/431] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:14.955086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b2d54-8b7a-4b1d-9847-4b31dde92396 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:14.978404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9039de-0193-4f4a-8480-8af949512168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:14.980023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9039de-0193-4f4a-8480-8af949512168 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:14.980304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9039de-0193-4f4a-8480-8af949512168 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:14.980575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9039de-0193-4f4a-8480-8af949512168 None admin] PATH_INFO: `/v3/projects/b77ea42af6f745e0af87a131f9212231` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:14.981969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9039de-0193-4f4a-8480-8af949512168 None admin] RBAC: Authorizing `identity:get_project(project_id=b77ea42af6f745e0af87a131f9212231)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:14.983444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9039de-0193-4f4a-8480-8af949512168 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:14.985664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 211/432] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:14 2022] GET /identity/v3/projects/b77ea42af6f745e0af87a131f9212231 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:14.992078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9039de-0193-4f4a-8480-8af949512168 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:15.022550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:15.081079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b2d54-8b7a-4b1d-9847-4b31dde92396 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:15.117050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8551ac-1b42-4640-9f91-3318a0858a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:15.118171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8551ac-1b42-4640-9f91-3318a0858a80 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:15.118648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8551ac-1b42-4640-9f91-3318a0858a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:15.119089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8551ac-1b42-4640-9f91-3318a0858a80 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:15.120450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8551ac-1b42-4640-9f91-3318a0858a80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:15.121405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8551ac-1b42-4640-9f91-3318a0858a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:15.121932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9039de-0193-4f4a-8480-8af949512168 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:15.123450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8551ac-1b42-4640-9f91-3318a0858a80 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:15.133586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 222/433] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:05:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:15.139222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8551ac-1b42-4640-9f91-3318a0858a80 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:15.170987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a16d2-6370-4194-9aa7-f1388aea2a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:15.172093 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a16d2-6370-4194-9aa7-f1388aea2a6e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:15.172374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a16d2-6370-4194-9aa7-f1388aea2a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:15.172645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a16d2-6370-4194-9aa7-f1388aea2a6e None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:15.174474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a16d2-6370-4194-9aa7-f1388aea2a6e None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:15.175914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a16d2-6370-4194-9aa7-f1388aea2a6e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:15.183590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 212/434] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:14 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:15.184803 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a16d2-6370-4194-9aa7-f1388aea2a6e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:15.224274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:15.250198 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8551ac-1b42-4640-9f91-3318a0858a80 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:15.264060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:15.287150 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b84b5-33b4-419f-9b02-7d548b9f113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:15.287802 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b84b5-33b4-419f-9b02-7d548b9f113b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:15.288081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b84b5-33b4-419f-9b02-7d548b9f113b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:15.288351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b84b5-33b4-419f-9b02-7d548b9f113b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:15.310913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a16d2-6370-4194-9aa7-f1388aea2a6e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:15.345015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e308-9cb3-40b5-a8cc-773f7987e8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:15.345679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e308-9cb3-40b5-a8cc-773f7987e8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:15.345958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e308-9cb3-40b5-a8cc-773f7987e8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:15.346230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e308-9cb3-40b5-a8cc-773f7987e8a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:15.347065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7e308-9cb3-40b5-a8cc-773f7987e8a7 None admin] RBAC: Adding query filter params (group.id=d95c8d2da30c4ceba163b590b58aa1b0, role.id=1790dd5eeda1419ca41830c6448c63fe, scope.project.id=b77ea42af6f745e0af87a131f9212231) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:15.347376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7e308-9cb3-40b5-a8cc-773f7987e8a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:15.348835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7e308-9cb3-40b5-a8cc-773f7987e8a7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:15.355283 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 213/435] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jul 14 09:05:15 2022] GET /identity/v3/role_assignments?group.id=d95c8d2da30c4ceba163b590b58aa1b0&scope.project.id=b77ea42af6f745e0af87a131f9212231&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:15.356585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ab69-0b81-421d-acc4-f9568e4bab34 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:15.356997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ab69-0b81-421d-acc4-f9568e4bab34 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:15.357278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ab69-0b81-421d-acc4-f9568e4bab34 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:15.358693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 214/436] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:15.365463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee9b37-ed6b-4546-9783-2faba44d9d2f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:15.365991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee9b37-ed6b-4546-9783-2faba44d9d2f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:15.366111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee9b37-ed6b-4546-9783-2faba44d9d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:15.382035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b84b5-33b4-419f-9b02-7d548b9f113b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:15.388700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b84b5-33b4-419f-9b02-7d548b9f113b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:15.388896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f4ee9b37-ed6b-4546-9783-2faba44d9d2f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:15.388896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f4ee9b37-ed6b-4546-9783-2faba44d9d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:15.469371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 215/437] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:15.489002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee9b37-ed6b-4546-9783-2faba44d9d2f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:15.513036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 223/438] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:15.519452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b84b5-33b4-419f-9b02-7d548b9f113b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:15.521711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:15.539664 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:15.606187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee9b37-ed6b-4546-9783-2faba44d9d2f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:15.646972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b84b5-33b4-419f-9b02-7d548b9f113b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:15.651093 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038df9-5dbc-4c8e-bcb1-fe5a6b99310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:15.651093 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038df9-5dbc-4c8e-bcb1-fe5a6b99310a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:15.651294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038df9-5dbc-4c8e-bcb1-fe5a6b99310a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:15.651557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038df9-5dbc-4c8e-bcb1-fe5a6b99310a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:15.665786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e038df9-5dbc-4c8e-bcb1-fe5a6b99310a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-5e038df9-5dbc-4c8e-bcb1-fe5a6b99310a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:15.675309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:15.676239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:15.677104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 216/439] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:05:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:15.683520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038df9-5dbc-4c8e-bcb1-fe5a6b99310a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:15.694005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d32ed-dc55-4e95-98ad-7c939c730b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:15.694896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d32ed-dc55-4e95-98ad-7c939c730b2c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:15.695175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d32ed-dc55-4e95-98ad-7c939c730b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:15.695446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d32ed-dc55-4e95-98ad-7c939c730b2c None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:15.696729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d32ed-dc55-4e95-98ad-7c939c730b2c None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:15.698275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d32ed-dc55-4e95-98ad-7c939c730b2c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:15.700216 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 224/440] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:15 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:15.705494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d32ed-dc55-4e95-98ad-7c939c730b2c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:15.799117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:15.802314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:15.820258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038df9-5dbc-4c8e-bcb1-fe5a6b99310a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:15.826983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d32ed-dc55-4e95-98ad-7c939c730b2c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:15.863328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9719e2-8425-4638-99f5-afdacf0baeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:15.863328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9719e2-8425-4638-99f5-afdacf0baeaa None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:15.863328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9719e2-8425-4638-99f5-afdacf0baeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:15.863328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9719e2-8425-4638-99f5-afdacf0baeaa None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:15.863755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9719e2-8425-4638-99f5-afdacf0baeaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:15.863755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9719e2-8425-4638-99f5-afdacf0baeaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:15.866007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9719e2-8425-4638-99f5-afdacf0baeaa None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:15.872524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1feba-7a25-43f1-b47a-be8e158ec556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:15.873621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 217/441] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:15.873730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1feba-7a25-43f1-b47a-be8e158ec556 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:15.873962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1feba-7a25-43f1-b47a-be8e158ec556 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:15.874242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1feba-7a25-43f1-b47a-be8e158ec556 None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:15.875536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1feba-7a25-43f1-b47a-be8e158ec556 None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:15.877018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1feba-7a25-43f1-b47a-be8e158ec556 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:15.878732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 225/442] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:15 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:15.878900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9719e2-8425-4638-99f5-afdacf0baeaa None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:15.884882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1feba-7a25-43f1-b47a-be8e158ec556 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:15.993713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9719e2-8425-4638-99f5-afdacf0baeaa None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:16.011195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1feba-7a25-43f1-b47a-be8e158ec556 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:16.037808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a19b2b-107b-4085-a027-d6a2f7d6b52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:16.038470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19b2b-107b-4085-a027-d6a2f7d6b52b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:16.038758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19b2b-107b-4085-a027-d6a2f7d6b52b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:16.039035 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19b2b-107b-4085-a027-d6a2f7d6b52b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:16.049223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cafd9a-56e6-4bac-9116-b83c2609d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:16.049820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cafd9a-56e6-4bac-9116-b83c2609d047 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:16.050100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cafd9a-56e6-4bac-9116-b83c2609d047 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:16.050378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cafd9a-56e6-4bac-9116-b83c2609d047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:16.051213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cafd9a-56e6-4bac-9116-b83c2609d047 None admin] RBAC: Adding query filter params (group.id=d95c8d2da30c4ceba163b590b58aa1b0, role.id=1790dd5eeda1419ca41830c6448c63fe, scope.project.id=68adc705690343aca7cbb550db0fe39c) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:16.051512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cafd9a-56e6-4bac-9116-b83c2609d047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:16.052978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cafd9a-56e6-4bac-9116-b83c2609d047 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:16.055003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:16.058914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 226/443] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jul 14 09:05:15 2022] GET /identity/v3/role_assignments?group.id=d95c8d2da30c4ceba163b590b58aa1b0&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=1790dd5eeda1419ca41830c6448c63fe => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:16.060121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576303-2020-4302-ac3f-548b825088c7 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:16.060407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576303-2020-4302-ac3f-548b825088c7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:16.060759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576303-2020-4302-ac3f-548b825088c7 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:16.061947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 227/444] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:16.067615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4bd89-b980-484e-aabf-4ff6efd369fd None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:16.067921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4bd89-b980-484e-aabf-4ff6efd369fd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:16.068172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4bd89-b980-484e-aabf-4ff6efd369fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:16.086382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5af4bd89-b980-484e-aabf-4ff6efd369fd None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:16.087597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5af4bd89-b980-484e-aabf-4ff6efd369fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:16.096229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:16.122514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a19b2b-107b-4085-a027-d6a2f7d6b52b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:16.123978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a19b2b-107b-4085-a027-d6a2f7d6b52b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:16.163727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 228/445] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:16.187832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4bd89-b980-484e-aabf-4ff6efd369fd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:16.241845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 218/446] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:05:16.248328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a19b2b-107b-4085-a027-d6a2f7d6b52b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:16.309296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:16.309483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4bd89-b980-484e-aabf-4ff6efd369fd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:16.348631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96141942-49b6-43bf-815a-6fc7a9a530ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:16.349468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96141942-49b6-43bf-815a-6fc7a9a530ee None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:16.349755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96141942-49b6-43bf-815a-6fc7a9a530ee None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:16.350032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96141942-49b6-43bf-815a-6fc7a9a530ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:16.361812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96141942-49b6-43bf-815a-6fc7a9a530ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-96141942-49b6-43bf-815a-6fc7a9a530ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:16.370928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:16.371838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:16.372676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:16.373316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a19b2b-107b-4085-a027-d6a2f7d6b52b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:16.375281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 229/447] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:16.381219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96141942-49b6-43bf-815a-6fc7a9a530ee None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:16.384162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:16.424162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f427-2d36-4b7c-8be5-39079843672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:16.425127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f427-2d36-4b7c-8be5-39079843672c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:16.425849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f427-2d36-4b7c-8be5-39079843672c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:16.426133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f427-2d36-4b7c-8be5-39079843672c None admin] PATH_INFO: `/v3/projects/68adc705690343aca7cbb550db0fe39c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:16.427541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f427-2d36-4b7c-8be5-39079843672c None admin] RBAC: Authorizing `identity:get_project(project_id=68adc705690343aca7cbb550db0fe39c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:16.429173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f427-2d36-4b7c-8be5-39079843672c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:16.432746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 219/448] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:16 2022] GET /identity/v3/projects/68adc705690343aca7cbb550db0fe39c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:16.437540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f427-2d36-4b7c-8be5-39079843672c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:16.489181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96141942-49b6-43bf-815a-6fc7a9a530ee None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:16.523461 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68357d-19ff-48c3-b5b9-7e5c791151ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:16.524126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68357d-19ff-48c3-b5b9-7e5c791151ba None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:16.524410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68357d-19ff-48c3-b5b9-7e5c791151ba None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:16.524703 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68357d-19ff-48c3-b5b9-7e5c791151ba None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:16.525519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68357d-19ff-48c3-b5b9-7e5c791151ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:16.525828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68357d-19ff-48c3-b5b9-7e5c791151ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:16.527241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68357d-19ff-48c3-b5b9-7e5c791151ba None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:16.535505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 230/449] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:16.536522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f427-2d36-4b7c-8be5-39079843672c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:16.541514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68357d-19ff-48c3-b5b9-7e5c791151ba None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:16.551643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:16.573499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a67b6-9f46-409c-9746-78692bd666fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:16.574293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a67b6-9f46-409c-9746-78692bd666fb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:16.574574 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a67b6-9f46-409c-9746-78692bd666fb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:16.574845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a67b6-9f46-409c-9746-78692bd666fb None admin] PATH_INFO: `/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:16.576023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a67b6-9f46-409c-9746-78692bd666fb None admin] RBAC: Authorizing `identity:get_group(group_id=d95c8d2da30c4ceba163b590b58aa1b0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:16.577505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a67b6-9f46-409c-9746-78692bd666fb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:16.579126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 220/450] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:16 2022] GET /identity/v3/groups/d95c8d2da30c4ceba163b590b58aa1b0 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:16.584961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a67b6-9f46-409c-9746-78692bd666fb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:16.603724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:16.642408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68357d-19ff-48c3-b5b9-7e5c791151ba None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:16.675416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae2447-c31b-4737-9ebc-e1fb69c7251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:16.676060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae2447-c31b-4737-9ebc-e1fb69c7251c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:16.676337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae2447-c31b-4737-9ebc-e1fb69c7251c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:16.676618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae2447-c31b-4737-9ebc-e1fb69c7251c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:16.685984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a67b6-9f46-409c-9746-78692bd666fb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:16.721080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7e09e-a12a-4101-98ee-95c385dc5b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:16.721725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7e09e-a12a-4101-98ee-95c385dc5b8e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:16.722006 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7e09e-a12a-4101-98ee-95c385dc5b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:16.722281 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7e09e-a12a-4101-98ee-95c385dc5b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:16.723108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7e09e-a12a-4101-98ee-95c385dc5b8e None admin] RBAC: Adding query filter params (group.id=d95c8d2da30c4ceba163b590b58aa1b0, role.id=45788771d2f1494a801cc09d365ff9e2, scope.project.id=68adc705690343aca7cbb550db0fe39c) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:16.723419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7e09e-a12a-4101-98ee-95c385dc5b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:16.724861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7e09e-a12a-4101-98ee-95c385dc5b8e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:16.731271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 221/451] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jul 14 09:05:16 2022] GET /identity/v3/role_assignments?group.id=d95c8d2da30c4ceba163b590b58aa1b0&scope.project.id=68adc705690343aca7cbb550db0fe39c&role.id=45788771d2f1494a801cc09d365ff9e2 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:16.745248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae2447-c31b-4737-9ebc-e1fb69c7251c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:16.746731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae2447-c31b-4737-9ebc-e1fb69c7251c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:16.813453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:16.857021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 231/452] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:05:16.862859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7e09e-a12a-4101-98ee-95c385dc5b8e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:16.912938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:16.970091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7e09e-a12a-4101-98ee-95c385dc5b8e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:17.005059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488947ad-f2f4-4111-9360-78c66a483762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:17.005933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488947ad-f2f4-4111-9360-78c66a483762 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:17.006214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488947ad-f2f4-4111-9360-78c66a483762 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:17.006516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488947ad-f2f4-4111-9360-78c66a483762 None admin] PATH_INFO: `/v3/projects/0f90549ec6704d3aa11b6699bd90eefe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:17.007683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488947ad-f2f4-4111-9360-78c66a483762 None admin] RBAC: Authorizing `identity:get_project(project_id=0f90549ec6704d3aa11b6699bd90eefe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:17.009153 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488947ad-f2f4-4111-9360-78c66a483762 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:17.011394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 222/453] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:05:16 2022] GET /identity/v3/projects/0f90549ec6704d3aa11b6699bd90eefe => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:17.017003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae2447-c31b-4737-9ebc-e1fb69c7251c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:17.116446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae2447-c31b-4737-9ebc-e1fb69c7251c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:17.152644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1ef14-bc4f-4e88-b4ae-63c8f90bf5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:17.153534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1ef14-bc4f-4e88-b4ae-63c8f90bf5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:17.153812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1ef14-bc4f-4e88-b4ae-63c8f90bf5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:17.154071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1ef14-bc4f-4e88-b4ae-63c8f90bf5a0 None admin] PATH_INFO: `/v3/groups/cafa0280f8304b5d93d7bf1e6d5c816d` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:17.155279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1ef14-bc4f-4e88-b4ae-63c8f90bf5a0 None admin] RBAC: Authorizing `identity:get_group(group_id=cafa0280f8304b5d93d7bf1e6d5c816d)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:17.156754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1ef14-bc4f-4e88-b4ae-63c8f90bf5a0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:17.158374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 232/454] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jul 14 09:05:17 2022] GET /identity/v3/groups/cafa0280f8304b5d93d7bf1e6d5c816d => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:17.164448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488947ad-f2f4-4111-9360-78c66a483762 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:17.273158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488947ad-f2f4-4111-9360-78c66a483762 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:17.287291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:17.311025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875d74c-920f-4dee-8800-a8dea5317f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:17.311662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875d74c-920f-4dee-8800-a8dea5317f44 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:17.311946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875d74c-920f-4dee-8800-a8dea5317f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:17.312223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875d74c-920f-4dee-8800-a8dea5317f44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:17.313083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875d74c-920f-4dee-8800-a8dea5317f44 None admin] RBAC: Adding query filter params (group.id=cafa0280f8304b5d93d7bf1e6d5c816d, role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=0f90549ec6704d3aa11b6699bd90eefe) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:17.313393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875d74c-920f-4dee-8800-a8dea5317f44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:17.314818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875d74c-920f-4dee-8800-a8dea5317f44 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:17.320695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 223/455] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jul 14 09:05:17 2022] GET /identity/v3/role_assignments?group.id=cafa0280f8304b5d93d7bf1e6d5c816d&scope.project.id=0f90549ec6704d3aa11b6699bd90eefe&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:19.922492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c95e1-b822-47e1-8e61-8560db9a90e8 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:19.922492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c95e1-b822-47e1-8e61-8560db9a90e8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:19.922492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c95e1-b822-47e1-8e61-8560db9a90e8 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:19.923629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 233/456] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:19.927581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e22ef2-cb53-4f40-8d49-67d3bcf69347 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:19.927961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e22ef2-cb53-4f40-8d49-67d3bcf69347 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:19.928127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e22ef2-cb53-4f40-8d49-67d3bcf69347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:19.953648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a8e22ef2-cb53-4f40-8d49-67d3bcf69347 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:19.955098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a8e22ef2-cb53-4f40-8d49-67d3bcf69347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:20.026764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f822-d0cb-4132-a610-b669bab71d6b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.027140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f822-d0cb-4132-a610-b669bab71d6b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.027488 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f822-d0cb-4132-a610-b669bab71d6b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.029229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 234/457] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:05:20.034165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f4366-f92d-47eb-935d-eb397c4e2659 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.034698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f4366-f92d-47eb-935d-eb397c4e2659 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.035183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f4366-f92d-47eb-935d-eb397c4e2659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.043956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 224/458] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:20.050562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa647d3-bc56-4689-9f09-360c5f03b703 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.051030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa647d3-bc56-4689-9f09-360c5f03b703 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.051440 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa647d3-bc56-4689-9f09-360c5f03b703 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.053151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 225/459] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:05:20.059605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af2897-6cf4-4f0b-a80e-e4ab4a3f09e5 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.060047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af2897-6cf4-4f0b-a80e-e4ab4a3f09e5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.060474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af2897-6cf4-4f0b-a80e-e4ab4a3f09e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.066152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b11f4366-f92d-47eb-935d-eb397c4e2659 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:20.068022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b11f4366-f92d-47eb-935d-eb397c4e2659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:20.083642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a9af2897-6cf4-4f0b-a80e-e4ab4a3f09e5 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:20.085215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a9af2897-6cf4-4f0b-a80e-e4ab4a3f09e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:20.094889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:20.152686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 235/460] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:20.152686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f4366-f92d-47eb-935d-eb397c4e2659 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:20.173037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 226/461] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:20.173777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af2897-6cf4-4f0b-a80e-e4ab4a3f09e5 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:20.234495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:20.303791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f4366-f92d-47eb-935d-eb397c4e2659 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:20.316716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af2897-6cf4-4f0b-a80e-e4ab4a3f09e5 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:20.347360 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065971c-e98a-4ab0-85ed-884df6054792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:20.348428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065971c-e98a-4ab0-85ed-884df6054792 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.348753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065971c-e98a-4ab0-85ed-884df6054792 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.349031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065971c-e98a-4ab0-85ed-884df6054792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.359641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69f045-2a42-41fb-9a95-012ecfb483fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:20.364484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065971c-e98a-4ab0-85ed-884df6054792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:20.366172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065971c-e98a-4ab0-85ed-884df6054792 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:20.366592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69f045-2a42-41fb-9a95-012ecfb483fe None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.367110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69f045-2a42-41fb-9a95-012ecfb483fe None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.367584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69f045-2a42-41fb-9a95-012ecfb483fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.384213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69f045-2a42-41fb-9a95-012ecfb483fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:20.386095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69f045-2a42-41fb-9a95-012ecfb483fe None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-f065971c-e98a-4ab0-85ed-884df6054792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:20.389374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:20.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:20.391083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:20.391083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:20.391083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:20.391083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:20.391083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 236/462] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:20.391351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065971c-e98a-4ab0-85ed-884df6054792 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:20.407946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-bc69f045-2a42-41fb-9a95-012ecfb483fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:20.408218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:20.409369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:20.410386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:20.410386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:20.410386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:20.410386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:20.410386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 227/463] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:20.411342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbafa8-67e9-435f-9c05-c00f60c56484 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.411342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbafa8-67e9-435f-9c05-c00f60c56484 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.411598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbafa8-67e9-435f-9c05-c00f60c56484 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.415351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 228/464] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:20.416350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbafa8-67e9-435f-9c05-c00f60c56484 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:20.503289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065971c-e98a-4ab0-85ed-884df6054792 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:20.515091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:20.529348 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbafa8-67e9-435f-9c05-c00f60c56484 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:20.538472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4b5e3-d482-4def-9470-aa9407132d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:20.539579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b5e3-d482-4def-9470-aa9407132d66 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.539976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b5e3-d482-4def-9470-aa9407132d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.540248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b5e3-d482-4def-9470-aa9407132d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.550814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4b5e3-d482-4def-9470-aa9407132d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:20.552256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4b5e3-d482-4def-9470-aa9407132d66 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:20.566822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b47655-674a-463c-a597-4d414f39214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:20.567489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b47655-674a-463c-a597-4d414f39214d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.567771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b47655-674a-463c-a597-4d414f39214d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.568042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b47655-674a-463c-a597-4d414f39214d None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.568790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b47655-674a-463c-a597-4d414f39214d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:20.569093 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b47655-674a-463c-a597-4d414f39214d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:20.570452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b47655-674a-463c-a597-4d414f39214d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-33b4b5e3-d482-4def-9470-aa9407132d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:20.571039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:20.571947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:20.572910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:20.572910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:20.572910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:20.572910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:20.577218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 237/465] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:20.577845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4b5e3-d482-4def-9470-aa9407132d66 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:20.588961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 229/466] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:20.588961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b0a78-195c-4335-afa1-54b88bd8bb8c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.588961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b0a78-195c-4335-afa1-54b88bd8bb8c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.588961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b0a78-195c-4335-afa1-54b88bd8bb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.604335 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-185b0a78-195c-4335-afa1-54b88bd8bb8c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:20.605544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-185b0a78-195c-4335-afa1-54b88bd8bb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:20.645940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:20.682018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 230/467] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:20.682886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b0a78-195c-4335-afa1-54b88bd8bb8c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:20.683361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4b5e3-d482-4def-9470-aa9407132d66 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:20.729109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff45017-dc89-4b76-a930-12307e10e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:20.730166 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45017-dc89-4b76-a930-12307e10e51f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.730661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45017-dc89-4b76-a930-12307e10e51f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.731013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45017-dc89-4b76-a930-12307e10e51f None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.731799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff45017-dc89-4b76-a930-12307e10e51f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:20.732240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff45017-dc89-4b76-a930-12307e10e51f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:20.733834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff45017-dc89-4b76-a930-12307e10e51f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:20.746488 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 238/468] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:20.747576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff45017-dc89-4b76-a930-12307e10e51f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:20.782988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:20.806029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b0a78-195c-4335-afa1-54b88bd8bb8c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:20.845677 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fc084-84c3-44cd-a813-cf5b8c4baae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:20.846768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fc084-84c3-44cd-a813-cf5b8c4baae7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.847190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fc084-84c3-44cd-a813-cf5b8c4baae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.847603 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fc084-84c3-44cd-a813-cf5b8c4baae7 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.848586 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fc084-84c3-44cd-a813-cf5b8c4baae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:20.849125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fc084-84c3-44cd-a813-cf5b8c4baae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:20.850629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fc084-84c3-44cd-a813-cf5b8c4baae7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:20.851467 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff45017-dc89-4b76-a930-12307e10e51f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:20.864678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 231/469] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:20.865873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fc084-84c3-44cd-a813-cf5b8c4baae7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:20.881420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:20.890760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ad79f-18f9-4cf9-b404-eaa94751244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:20.891422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ad79f-18f9-4cf9-b404-eaa94751244f None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:20.891722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ad79f-18f9-4cf9-b404-eaa94751244f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:20.891998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ad79f-18f9-4cf9-b404-eaa94751244f None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:20.892719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ad79f-18f9-4cf9-b404-eaa94751244f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:20.894152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ad79f-18f9-4cf9-b404-eaa94751244f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:20.924763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 239/470] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:05:20 2022] POST /identity/v3/users => generated 248 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:05:20.924763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ad79f-18f9-4cf9-b404-eaa94751244f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:21.000144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fc084-84c3-44cd-a813-cf5b8c4baae7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:21.039478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ad79f-18f9-4cf9-b404-eaa94751244f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:21.046884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8efae9-57ed-4bb0-a198-1fad77aa8539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:21.048477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8efae9-57ed-4bb0-a198-1fad77aa8539 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:21.048900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8efae9-57ed-4bb0-a198-1fad77aa8539 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:21.049332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8efae9-57ed-4bb0-a198-1fad77aa8539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:21.063509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:21.066301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8efae9-57ed-4bb0-a198-1fad77aa8539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:21.068907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8efae9-57ed-4bb0-a198-1fad77aa8539 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:21.080981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3a7f-a853-43a4-97bc-06716b5b45d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:21.081670 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3a7f-a853-43a4-97bc-06716b5b45d5 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:21.081953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3a7f-a853-43a4-97bc-06716b5b45d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:21.082232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3a7f-a853-43a4-97bc-06716b5b45d5 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:21.082969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a3a7f-a853-43a4-97bc-06716b5b45d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:21.084460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a3a7f-a853-43a4-97bc-06716b5b45d5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-7e8efae9-57ed-4bb0-a198-1fad77aa8539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:21.091999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:21.093046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:21.093886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:21.093886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:21.093886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:21.093886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:21.093886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 232/471] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:21.095121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8efae9-57ed-4bb0-a198-1fad77aa8539 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:21.119925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 240/472] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:05:20 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:05:21.121856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3a7f-a853-43a4-97bc-06716b5b45d5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:21.180498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:21.221057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8efae9-57ed-4bb0-a198-1fad77aa8539 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:21.264375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3a7f-a853-43a4-97bc-06716b5b45d5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:21.269881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28ba1-c333-432f-a297-eb41b36d4817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:21.270574 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28ba1-c333-432f-a297-eb41b36d4817 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:21.270856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28ba1-c333-432f-a297-eb41b36d4817 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:21.271129 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28ba1-c333-432f-a297-eb41b36d4817 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:21.271854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28ba1-c333-432f-a297-eb41b36d4817 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:21.273361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28ba1-c333-432f-a297-eb41b36d4817 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:21.300569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 233/473] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:05:21 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:05:21.302180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197433fd-4f02-4724-bc7d-59db6b252806 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:21.302474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197433fd-4f02-4724-bc7d-59db6b252806 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:21.302749 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197433fd-4f02-4724-bc7d-59db6b252806 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:21.308396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 234/474] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:21.310348 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c1e8e-d656-4e2a-bcd4-152ca5ce57bb None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:21.310640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c1e8e-d656-4e2a-bcd4-152ca5ce57bb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:21.310915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c1e8e-d656-4e2a-bcd4-152ca5ce57bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:21.316943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e88be7-3872-4d03-bc04-0a7b190fef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:21.318014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e88be7-3872-4d03-bc04-0a7b190fef46 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:21.318477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e88be7-3872-4d03-bc04-0a7b190fef46 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:21.318962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e88be7-3872-4d03-bc04-0a7b190fef46 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:21.319911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e88be7-3872-4d03-bc04-0a7b190fef46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:21.320400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e88be7-3872-4d03-bc04-0a7b190fef46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:21.322373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e88be7-3872-4d03-bc04-0a7b190fef46 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:21.334140 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-be9c1e8e-d656-4e2a-bcd4-152ca5ce57bb None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:21.335571 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-be9c1e8e-d656-4e2a-bcd4-152ca5ce57bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:21.344279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 241/475] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:21.350201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e88be7-3872-4d03-bc04-0a7b190fef46 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:21.397958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:21.432863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 235/476] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:21.455509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c1e8e-d656-4e2a-bcd4-152ca5ce57bb None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:21.467503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:21.472402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e88be7-3872-4d03-bc04-0a7b190fef46 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:21.515388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aefd0-290c-4c0d-8074-11a8392075e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:21.516180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aefd0-290c-4c0d-8074-11a8392075e2 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:21.516521 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aefd0-290c-4c0d-8074-11a8392075e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:21.516814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aefd0-290c-4c0d-8074-11a8392075e2 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:21.517618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9aefd0-290c-4c0d-8074-11a8392075e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:21.519066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9aefd0-290c-4c0d-8074-11a8392075e2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:21.545134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 242/477] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:05:21 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:05:21.577265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c1e8e-d656-4e2a-bcd4-152ca5ce57bb None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:21.618662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3accf7-bf57-41ad-ac2f-34fb081cb784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:21.619461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3accf7-bf57-41ad-ac2f-34fb081cb784 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:21.619745 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3accf7-bf57-41ad-ac2f-34fb081cb784 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:21.620021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3accf7-bf57-41ad-ac2f-34fb081cb784 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:21.620891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3accf7-bf57-41ad-ac2f-34fb081cb784 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:21.622473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3accf7-bf57-41ad-ac2f-34fb081cb784 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:21.630631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.sql.core [None req-0e3accf7-bf57-41ad-ac2f-34fb081cb784 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 09:05:21.630631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 09:05:21.630631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [parameters: {'id': '9b4c3cad06a9436c8f85c5f83209ae7f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 09:05:21.630631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80205) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-0e3accf7-bf57-41ad-ac2f-34fb081cb784 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result.read() Jul 14 09:05:21.648976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:05:21.650086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application yield resource Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise self.value Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application session.commit() Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 09:05:21.650992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.session.flush() Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application compat.raise_( Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 09:05:21.652271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:05:21.654790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result.read() Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:05:21.656744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [parameters: {'id': '9b4c3cad06a9436c8f85c5f83209ae7f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:21.658716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 09:05:21.660731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:21.662467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 236/478] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jul 14 09:05:21 2022] POST /identity/v3/roles => generated 144 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:21.662548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aefd0-290c-4c0d-8074-11a8392075e2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:21.779569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aefd0-290c-4c0d-8074-11a8392075e2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:21.815421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa2a18-2071-4aca-bb85-b05067cc5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:21.816250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2a18-2071-4aca-bb85-b05067cc5a11 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:21.816535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2a18-2071-4aca-bb85-b05067cc5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:21.816846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2a18-2071-4aca-bb85-b05067cc5a11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:21.827786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa2a18-2071-4aca-bb85-b05067cc5a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-3eaa2a18-2071-4aca-bb85-b05067cc5a11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:21.835980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:21.838032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:21.839130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 243/479] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:05:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:21.843454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3accf7-bf57-41ad-ac2f-34fb081cb784 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:21.900576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:21.962723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3accf7-bf57-41ad-ac2f-34fb081cb784 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:21.999105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736c05a-707f-4a88-ae0f-e6b6886881fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:22.000134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736c05a-707f-4a88-ae0f-e6b6886881fe None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:22.000621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736c05a-707f-4a88-ae0f-e6b6886881fe None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:22.001559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736c05a-707f-4a88-ae0f-e6b6886881fe None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:22.002564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736c05a-707f-4a88-ae0f-e6b6886881fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:22.003075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736c05a-707f-4a88-ae0f-e6b6886881fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:22.004646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736c05a-707f-4a88-ae0f-e6b6886881fe None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:22.014058 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 237/480] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:23.636601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a26c1-d6dc-4eeb-aec8-34a42d520196 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:23.637651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a26c1-d6dc-4eeb-aec8-34a42d520196 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:23.638142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a26c1-d6dc-4eeb-aec8-34a42d520196 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:23.640154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 244/481] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:23.645648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b71039-bb61-4d2a-adf3-477c0d05da09 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:23.646600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b71039-bb61-4d2a-adf3-477c0d05da09 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:23.647104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b71039-bb61-4d2a-adf3-477c0d05da09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:23.673656 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-22b71039-bb61-4d2a-adf3-477c0d05da09 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:23.675191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-22b71039-bb61-4d2a-adf3-477c0d05da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:23.764475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 238/482] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:23.799117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a26c1-d6dc-4eeb-aec8-34a42d520196 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:23.810276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a7d2-9212-41e6-9551-bb04ec0d4094 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:23.812594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a7d2-9212-41e6-9551-bb04ec0d4094 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:23.813041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a7d2-9212-41e6-9551-bb04ec0d4094 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:23.815154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 239/483] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:05:23.821414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c05f8b-a1b7-4448-9520-cff46ea04aaf None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:23.821707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c05f8b-a1b7-4448-9520-cff46ea04aaf None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:23.822016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c05f8b-a1b7-4448-9520-cff46ea04aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:23.826663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:23.857742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e0c05f8b-a1b7-4448-9520-cff46ea04aaf None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:23.858949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e0c05f8b-a1b7-4448-9520-cff46ea04aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:23.917743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:23.935495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a26c1-d6dc-4eeb-aec8-34a42d520196 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:23.973101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 240/484] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:23.998218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c05f8b-a1b7-4448-9520-cff46ea04aaf None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:24.011970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71184d0-839c-4f8f-bdbe-16626aa68300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:24.013472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71184d0-839c-4f8f-bdbe-16626aa68300 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.013961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71184d0-839c-4f8f-bdbe-16626aa68300 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.014565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71184d0-839c-4f8f-bdbe-16626aa68300 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.029102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71184d0-839c-4f8f-bdbe-16626aa68300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d71184d0-839c-4f8f-bdbe-16626aa68300 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:24.039602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:24.040524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:24.041390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:24.044493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 245/485] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:24.046679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099090dc-431f-424f-a710-4aa61fd5d3f8 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.047416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099090dc-431f-424f-a710-4aa61fd5d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.047877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099090dc-431f-424f-a710-4aa61fd5d3f8 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.049684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 246/486] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:24.050992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099090dc-431f-424f-a710-4aa61fd5d3f8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:24.129071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c05f8b-a1b7-4448-9520-cff46ea04aaf None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:24.140072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:24.170681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099090dc-431f-424f-a710-4aa61fd5d3f8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:24.178968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2fbe-1cc3-4dc8-9b26-df7875b5c2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:24.180111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2fbe-1cc3-4dc8-9b26-df7875b5c2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.180679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2fbe-1cc3-4dc8-9b26-df7875b5c2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.181598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2fbe-1cc3-4dc8-9b26-df7875b5c2b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.196171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b2fbe-1cc3-4dc8-9b26-df7875b5c2b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-cb4b2fbe-1cc3-4dc8-9b26-df7875b5c2b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:24.204539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:24.205512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:24.206321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:24.211056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 241/487] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:24.212645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41257f66-19bf-439a-95f9-959adc3135ee None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.212957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41257f66-19bf-439a-95f9-959adc3135ee None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.213235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41257f66-19bf-439a-95f9-959adc3135ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.214854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a7d3c-c142-44bf-bbac-7351c36d1bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:24.215901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a7d3c-c142-44bf-bbac-7351c36d1bcb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.216383 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a7d3c-c142-44bf-bbac-7351c36d1bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.217017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a7d3c-c142-44bf-bbac-7351c36d1bcb None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.217991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a7d3c-c142-44bf-bbac-7351c36d1bcb None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:24.218805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a7d3c-c142-44bf-bbac-7351c36d1bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:24.222860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a7d3c-c142-44bf-bbac-7351c36d1bcb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:24.231026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-41257f66-19bf-439a-95f9-959adc3135ee None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:24.232218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-41257f66-19bf-439a-95f9-959adc3135ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:24.237650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 247/488] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:24.238751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a7d3c-c142-44bf-bbac-7351c36d1bcb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:24.251596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:24.316834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 242/489] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:24.318083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41257f66-19bf-439a-95f9-959adc3135ee None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:24.363207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a7d3c-c142-44bf-bbac-7351c36d1bcb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:24.400650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9391925-ea6b-4a87-bcee-0e582a989787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:24.401357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9391925-ea6b-4a87-bcee-0e582a989787 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.401643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9391925-ea6b-4a87-bcee-0e582a989787 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.401921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9391925-ea6b-4a87-bcee-0e582a989787 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.402668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9391925-ea6b-4a87-bcee-0e582a989787 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:24.402977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9391925-ea6b-4a87-bcee-0e582a989787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:24.404343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9391925-ea6b-4a87-bcee-0e582a989787 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:24.407309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:24.415186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 248/490] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:24.416577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f6f1-9730-4d01-a383-cc4e55ed9395 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.416892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f6f1-9730-4d01-a383-cc4e55ed9395 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.417167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f6f1-9730-4d01-a383-cc4e55ed9395 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.418553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 249/491] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:24.423375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338f6f1-9730-4d01-a383-cc4e55ed9395 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:24.442741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41257f66-19bf-439a-95f9-959adc3135ee None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:24.479945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b28f-614b-4e99-baf8-32bec8b5da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:24.481070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b28f-614b-4e99-baf8-32bec8b5da58 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.481524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b28f-614b-4e99-baf8-32bec8b5da58 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.481965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b28f-614b-4e99-baf8-32bec8b5da58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.494687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8b28f-614b-4e99-baf8-32bec8b5da58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:24.496159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8b28f-614b-4e99-baf8-32bec8b5da58 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f0f8b28f-614b-4e99-baf8-32bec8b5da58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:24.514344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:24.515226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:24.516070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:24.516070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:24.516070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:24.516070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:24.520164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 243/492] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:24.521043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b28f-614b-4e99-baf8-32bec8b5da58 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:24.530773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:24.540754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338f6f1-9730-4d01-a383-cc4e55ed9395 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:24.576328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9a299-01ed-49e1-8ffc-127c22c2479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:24.577167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9a299-01ed-49e1-8ffc-127c22c2479c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.577445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9a299-01ed-49e1-8ffc-127c22c2479c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.577716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9a299-01ed-49e1-8ffc-127c22c2479c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.589251 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9a299-01ed-49e1-8ffc-127c22c2479c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-0fe9a299-01ed-49e1-8ffc-127c22c2479c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:24.596872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:24.597784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:24.598580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 250/493] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:24.599797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7cb3b-28e2-45a5-a03f-e62fa22a62ba None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.600409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7cb3b-28e2-45a5-a03f-e62fa22a62ba None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.600701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7cb3b-28e2-45a5-a03f-e62fa22a62ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.618094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-03a7cb3b-28e2-45a5-a03f-e62fa22a62ba None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:24.619290 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-03a7cb3b-28e2-45a5-a03f-e62fa22a62ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:24.634453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b28f-614b-4e99-baf8-32bec8b5da58 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:24.668857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8c848-8017-4763-8b5f-4c1571a36ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:24.669623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8c848-8017-4763-8b5f-4c1571a36ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.669926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8c848-8017-4763-8b5f-4c1571a36ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.670178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8c848-8017-4763-8b5f-4c1571a36ab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.673441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:24.681286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8c848-8017-4763-8b5f-4c1571a36ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:24.682732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8c848-8017-4763-8b5f-4c1571a36ab1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:24.687510 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 251/494] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:24.688314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7cb3b-28e2-45a5-a03f-e62fa22a62ba None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-88a8c848-8017-4763-8b5f-4c1571a36ab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:24.699995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:24.701027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:24.701909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:24.701909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:24.701909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:24.701909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:24.701909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 244/495] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:24.702552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae570f69-7ea7-4ce2-bf92-1c25880275e1 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.702706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae570f69-7ea7-4ce2-bf92-1c25880275e1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.702960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae570f69-7ea7-4ce2-bf92-1c25880275e1 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.704328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 245/496] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:24.704889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae570f69-7ea7-4ce2-bf92-1c25880275e1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:24.765355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:24.793152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7cb3b-28e2-45a5-a03f-e62fa22a62ba None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:24.808059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae570f69-7ea7-4ce2-bf92-1c25880275e1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:24.829994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adc09d-6e37-4f47-bce4-3dffa4567e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:24.830667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adc09d-6e37-4f47-bce4-3dffa4567e53 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.830947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adc09d-6e37-4f47-bce4-3dffa4567e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.831239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adc09d-6e37-4f47-bce4-3dffa4567e53 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.831967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adc09d-6e37-4f47-bce4-3dffa4567e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:24.832257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adc09d-6e37-4f47-bce4-3dffa4567e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:24.833666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adc09d-6e37-4f47-bce4-3dffa4567e53 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:24.842580 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca21913-f0d1-4450-aea1-80ec635fc12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:24.843234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21913-f0d1-4450-aea1-80ec635fc12d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.843520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21913-f0d1-4450-aea1-80ec635fc12d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.843789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21913-f0d1-4450-aea1-80ec635fc12d None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.844539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca21913-f0d1-4450-aea1-80ec635fc12d None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:24.844885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca21913-f0d1-4450-aea1-80ec635fc12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:24.845265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 252/497] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:24.846248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca21913-f0d1-4450-aea1-80ec635fc12d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:24.849626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adc09d-6e37-4f47-bce4-3dffa4567e53 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:24.854765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 246/498] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:24.855999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb676-2cd6-4dae-880a-9318810a0184 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.856287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb676-2cd6-4dae-880a-9318810a0184 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.856562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb676-2cd6-4dae-880a-9318810a0184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.872964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fc1cb676-2cd6-4dae-880a-9318810a0184 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:24.874205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fc1cb676-2cd6-4dae-880a-9318810a0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:24.899357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:24.941545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 247/499] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:24.942462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cb676-2cd6-4dae-880a-9318810a0184 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:24.951133 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adc09d-6e37-4f47-bce4-3dffa4567e53 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:24.985133 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db034f5-d0c7-4015-add8-6a244b793895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:24.985789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db034f5-d0c7-4015-add8-6a244b793895 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:24.986069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db034f5-d0c7-4015-add8-6a244b793895 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:24.986338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db034f5-d0c7-4015-add8-6a244b793895 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:24.987052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db034f5-d0c7-4015-add8-6a244b793895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:24.987369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db034f5-d0c7-4015-add8-6a244b793895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:24.988827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db034f5-d0c7-4015-add8-6a244b793895 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:24.991054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:25.005298 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 253/500] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:25.005298 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db034f5-d0c7-4015-add8-6a244b793895 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.044967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cb676-2cd6-4dae-880a-9318810a0184 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:25.081436 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf9afc-4c31-47fb-b247-86d1417437f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:25.082218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf9afc-4c31-47fb-b247-86d1417437f2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:25.082492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf9afc-4c31-47fb-b247-86d1417437f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:25.082761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf9afc-4c31-47fb-b247-86d1417437f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:25.093130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf9afc-4c31-47fb-b247-86d1417437f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-ecdf9afc-4c31-47fb-b247-86d1417437f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:25.100682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:25.102091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:25.102891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 248/501] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:25.103599 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db034f5-d0c7-4015-add8-6a244b793895 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:25.103673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf9afc-4c31-47fb-b247-86d1417437f2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.112413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:25.140808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1b776-b044-490b-be61-eb668aaad567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:25.141628 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1b776-b044-490b-be61-eb668aaad567 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:25.141895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1b776-b044-490b-be61-eb668aaad567 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:25.142189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1b776-b044-490b-be61-eb668aaad567 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:25.149710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1b776-b044-490b-be61-eb668aaad567 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:25.151157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1b776-b044-490b-be61-eb668aaad567 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5dd1b776-b044-490b-be61-eb668aaad567 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:25.167719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:25.168701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:25.169610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 254/502] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:25.170197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1b776-b044-490b-be61-eb668aaad567 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.209023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf9afc-4c31-47fb-b247-86d1417437f2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:25.219697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:25.244669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bb9cb-aab1-41d1-9223-d47524d91b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:25.245487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bb9cb-aab1-41d1-9223-d47524d91b2f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:25.245767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bb9cb-aab1-41d1-9223-d47524d91b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:25.246043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bb9cb-aab1-41d1-9223-d47524d91b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:25.256774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bb9cb-aab1-41d1-9223-d47524d91b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:25.258435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bb9cb-aab1-41d1-9223-d47524d91b2f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:25.270192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1b776-b044-490b-be61-eb668aaad567 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-0f1bb9cb-aab1-41d1-9223-d47524d91b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:25.279723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:25.280688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:25.281524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:25.281524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:25.281524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:25.281524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:25.281524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 249/503] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:25.281790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bb9cb-aab1-41d1-9223-d47524d91b2f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.310855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8b685-37bf-4957-99b8-ae18208b2ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:25.311655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8b685-37bf-4957-99b8-ae18208b2ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:25.311932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8b685-37bf-4957-99b8-ae18208b2ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:25.312202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8b685-37bf-4957-99b8-ae18208b2ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:25.322478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8b685-37bf-4957-99b8-ae18208b2ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:25.324039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8b685-37bf-4957-99b8-ae18208b2ea8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-79e8b685-37bf-4957-99b8-ae18208b2ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:25.341740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:25.342688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:25.343545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:25.343545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:25.343545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:25.343545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:25.343545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 255/504] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:25.343816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8b685-37bf-4957-99b8-ae18208b2ea8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.368175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:25.394172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bb9cb-aab1-41d1-9223-d47524d91b2f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:25.428138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d715be-a183-4688-9394-040c98392b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:25.428983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d715be-a183-4688-9394-040c98392b7d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:25.429372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d715be-a183-4688-9394-040c98392b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:25.429646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d715be-a183-4688-9394-040c98392b7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:25.437203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d715be-a183-4688-9394-040c98392b7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:25.438640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d715be-a183-4688-9394-040c98392b7d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:25.449718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8b685-37bf-4957-99b8-ae18208b2ea8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-14d715be-a183-4688-9394-040c98392b7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:25.459020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:25.460198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:25.461423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 250/505] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:25.462038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d715be-a183-4688-9394-040c98392b7d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.490135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820c602-e914-45c8-8087-6c8487b0fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:25.490813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c602-e914-45c8-8087-6c8487b0fc66 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:25.491377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c602-e914-45c8-8087-6c8487b0fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:25.491476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c602-e914-45c8-8087-6c8487b0fc66 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:25.492370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820c602-e914-45c8-8087-6c8487b0fc66 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:25.492541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:25.492886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820c602-e914-45c8-8087-6c8487b0fc66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:25.495081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820c602-e914-45c8-8087-6c8487b0fc66 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:25.503912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 256/506] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:25.504746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820c602-e914-45c8-8087-6c8487b0fc66 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.578334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d715be-a183-4688-9394-040c98392b7d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:25.593256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:25.612702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820c602-e914-45c8-8087-6c8487b0fc66 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:25.621624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047459e2-7db2-4890-9d65-e18f5d9f1336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:25.622311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047459e2-7db2-4890-9d65-e18f5d9f1336 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:25.622576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047459e2-7db2-4890-9d65-e18f5d9f1336 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:25.622875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047459e2-7db2-4890-9d65-e18f5d9f1336 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:25.623705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047459e2-7db2-4890-9d65-e18f5d9f1336 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:25.624031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047459e2-7db2-4890-9d65-e18f5d9f1336 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:25.627323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047459e2-7db2-4890-9d65-e18f5d9f1336 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:25.651754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c89c8-5721-4320-b3fe-2ef66c1bd082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:25.652432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c89c8-5721-4320-b3fe-2ef66c1bd082 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:25.652743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c89c8-5721-4320-b3fe-2ef66c1bd082 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:25.653023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c89c8-5721-4320-b3fe-2ef66c1bd082 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:25.653753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c89c8-5721-4320-b3fe-2ef66c1bd082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:25.654058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c89c8-5721-4320-b3fe-2ef66c1bd082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:25.655427 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c89c8-5721-4320-b3fe-2ef66c1bd082 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:25.672695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 251/507] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:25.673357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 257/508] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:25.673826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047459e2-7db2-4890-9d65-e18f5d9f1336 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.674137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c89c8-5721-4320-b3fe-2ef66c1bd082 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.787409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:25.800937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c89c8-5721-4320-b3fe-2ef66c1bd082 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:25.809652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047459e2-7db2-4890-9d65-e18f5d9f1336 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:25.845632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c891b-4d90-4e18-a6d5-4fb06be292d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:25.846300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c891b-4d90-4e18-a6d5-4fb06be292d2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:25.846574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c891b-4d90-4e18-a6d5-4fb06be292d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:25.846844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c891b-4d90-4e18-a6d5-4fb06be292d2 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:25.847729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c891b-4d90-4e18-a6d5-4fb06be292d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:25.848042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c891b-4d90-4e18-a6d5-4fb06be292d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:25.848496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65011-44bb-4184-ab3f-35ac6c9872dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:25.849201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65011-44bb-4184-ab3f-35ac6c9872dd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:25.849487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65011-44bb-4184-ab3f-35ac6c9872dd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:25.849589 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c891b-4d90-4e18-a6d5-4fb06be292d2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:25.849759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65011-44bb-4184-ab3f-35ac6c9872dd None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:25.852401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f65011-44bb-4184-ab3f-35ac6c9872dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:25.852750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f65011-44bb-4184-ab3f-35ac6c9872dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:25.854130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f65011-44bb-4184-ab3f-35ac6c9872dd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:25.865943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 252/509] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:25.867461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65011-44bb-4184-ab3f-35ac6c9872dd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.885793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:25.890485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 258/510] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:25.890756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c891b-4d90-4e18-a6d5-4fb06be292d2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:25.985996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65011-44bb-4184-ab3f-35ac6c9872dd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:26.005959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c891b-4d90-4e18-a6d5-4fb06be292d2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:26.023541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0bb7e-4d69-4a73-aa09-1b341fd6aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:26.024940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0bb7e-4d69-4a73-aa09-1b341fd6aae4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:26.025225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0bb7e-4d69-4a73-aa09-1b341fd6aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:26.025496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0bb7e-4d69-4a73-aa09-1b341fd6aae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:26.034881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:26.036984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0bb7e-4d69-4a73-aa09-1b341fd6aae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:26.038974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0bb7e-4d69-4a73-aa09-1b341fd6aae4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:26.041544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f5bc5-43cc-4f32-a81d-72a496737d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:26.042185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f5bc5-43cc-4f32-a81d-72a496737d80 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:26.042466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f5bc5-43cc-4f32-a81d-72a496737d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:26.042764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f5bc5-43cc-4f32-a81d-72a496737d80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-b6a0bb7e-4d69-4a73-aa09-1b341fd6aae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:26.060110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:26.061059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:26.061910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:26.061910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:26.061910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:26.061910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:26.061910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 253/511] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:26.062589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0bb7e-4d69-4a73-aa09-1b341fd6aae4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:26.118848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:26.121374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f5bc5-43cc-4f32-a81d-72a496737d80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:26.122991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f5bc5-43cc-4f32-a81d-72a496737d80 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:26.176351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0bb7e-4d69-4a73-aa09-1b341fd6aae4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:26.211765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c00afc-7407-4252-88de-8f28568d2539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:26.212566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c00afc-7407-4252-88de-8f28568d2539 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:26.212871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c00afc-7407-4252-88de-8f28568d2539 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:26.213141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c00afc-7407-4252-88de-8f28568d2539 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:26.221295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c00afc-7407-4252-88de-8f28568d2539 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:26.222733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c00afc-7407-4252-88de-8f28568d2539 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d4c00afc-7407-4252-88de-8f28568d2539 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:26.238133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:26.239105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:26.240041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:26.240041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:26.240041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:26.240041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:26.240041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:26.240041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:26.240041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:26.240041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:26.240041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:05:26.240041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:26.240553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 259/512] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:26.240624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 254/513] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:26.240624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c00afc-7407-4252-88de-8f28568d2539 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:26.240786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f5bc5-43cc-4f32-a81d-72a496737d80 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:26.308642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:26.356651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:26.359526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f5bc5-43cc-4f32-a81d-72a496737d80 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:26.364708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c00afc-7407-4252-88de-8f28568d2539 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:26.400362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891562a0-a18f-4fe2-bd96-b02b57143344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:26.400927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaad347-9b58-4a67-abce-d3cc09db690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:26.401060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891562a0-a18f-4fe2-bd96-b02b57143344 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:26.401338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891562a0-a18f-4fe2-bd96-b02b57143344 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:26.401580 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaad347-9b58-4a67-abce-d3cc09db690a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:26.401666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891562a0-a18f-4fe2-bd96-b02b57143344 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:26.401862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaad347-9b58-4a67-abce-d3cc09db690a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:26.402135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaad347-9b58-4a67-abce-d3cc09db690a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:26.402316 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891562a0-a18f-4fe2-bd96-b02b57143344 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:26.403755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891562a0-a18f-4fe2-bd96-b02b57143344 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:26.436691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 260/514] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:05:26 2022] POST /identity/v3/users => generated 247 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:05:26.436691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891562a0-a18f-4fe2-bd96-b02b57143344 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:26.490662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaad347-9b58-4a67-abce-d3cc09db690a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:26.492327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaad347-9b58-4a67-abce-d3cc09db690a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:26.548767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:26.556320 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891562a0-a18f-4fe2-bd96-b02b57143344 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:26.595587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3934-67ae-41fa-bdd9-62103723e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:26.596162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3934-67ae-41fa-bdd9-62103723e102 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:26.596437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3934-67ae-41fa-bdd9-62103723e102 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:26.596702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3934-67ae-41fa-bdd9-62103723e102 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:26.597425 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de3934-67ae-41fa-bdd9-62103723e102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:26.597723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de3934-67ae-41fa-bdd9-62103723e102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:26.599183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de3934-67ae-41fa-bdd9-62103723e102 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:26.604105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 255/515] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:26.604962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaad347-9b58-4a67-abce-d3cc09db690a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:26.620553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 261/516] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:26.620553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3934-67ae-41fa-bdd9-62103723e102 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:26.637134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:26.713176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaad347-9b58-4a67-abce-d3cc09db690a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:26.724627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3934-67ae-41fa-bdd9-62103723e102 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:26.750214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92f35d-6532-4735-9fde-e5197256be62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:26.751008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92f35d-6532-4735-9fde-e5197256be62 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:26.751288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92f35d-6532-4735-9fde-e5197256be62 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:26.751559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92f35d-6532-4735-9fde-e5197256be62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:26.761954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd5b29-179c-48df-997c-c9710b1030b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:26.762281 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92f35d-6532-4735-9fde-e5197256be62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:26.762628 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd5b29-179c-48df-997c-c9710b1030b7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:26.762914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd5b29-179c-48df-997c-c9710b1030b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:26.763193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd5b29-179c-48df-997c-c9710b1030b7 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:26.763756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92f35d-6532-4735-9fde-e5197256be62 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:26.764034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd5b29-179c-48df-997c-c9710b1030b7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:26.764394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd5b29-179c-48df-997c-c9710b1030b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:26.765801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd5b29-179c-48df-997c-c9710b1030b7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-fa92f35d-6532-4735-9fde-e5197256be62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:26.781487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:26.782401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:26.783298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:26.783298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:26.783298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:26.783298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:26.786259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 256/517] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:26.786259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92f35d-6532-4735-9fde-e5197256be62 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:26.790215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:26.791470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 262/518] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jul 14 09:05:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:26.792178 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd5b29-179c-48df-997c-c9710b1030b7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:26.873378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:26.895576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92f35d-6532-4735-9fde-e5197256be62 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:26.899244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd5b29-179c-48df-997c-c9710b1030b7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:26.932563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a992a2-c1a9-4b53-8ffe-12558b7921df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:26.933403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a992a2-c1a9-4b53-8ffe-12558b7921df None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:26.933691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a992a2-c1a9-4b53-8ffe-12558b7921df None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:26.933964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a992a2-c1a9-4b53-8ffe-12558b7921df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:26.936149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bd90b-ec73-41c9-80a6-4521c75c262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:26.937307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bd90b-ec73-41c9-80a6-4521c75c262c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:26.937863 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bd90b-ec73-41c9-80a6-4521c75c262c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:26.938140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bd90b-ec73-41c9-80a6-4521c75c262c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:26.944361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a992a2-c1a9-4b53-8ffe-12558b7921df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:26.946233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bd90b-ec73-41c9-80a6-4521c75c262c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:26.946443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a992a2-c1a9-4b53-8ffe-12558b7921df None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:26.947665 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bd90b-ec73-41c9-80a6-4521c75c262c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-f93bd90b-ec73-41c9-80a6-4521c75c262c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:26.962762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:26.963683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 263/519] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:26.969646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bd90b-ec73-41c9-80a6-4521c75c262c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-08a992a2-c1a9-4b53-8ffe-12558b7921df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:26.970280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:26.971495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:26.972331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:26.972331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:26.972331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:26.972331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:26.972331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 257/520] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:26.972331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a992a2-c1a9-4b53-8ffe-12558b7921df None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:27.032743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:27.078557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bd90b-ec73-41c9-80a6-4521c75c262c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:27.088268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a992a2-c1a9-4b53-8ffe-12558b7921df None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:27.118086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddd029-c9a6-4b69-8c8f-6a47d2f79478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:27.118920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd029-c9a6-4b69-8c8f-6a47d2f79478 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:27.119210 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd029-c9a6-4b69-8c8f-6a47d2f79478 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:27.119842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd029-c9a6-4b69-8c8f-6a47d2f79478 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:27.120735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddd029-c9a6-4b69-8c8f-6a47d2f79478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:27.121077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddd029-c9a6-4b69-8c8f-6a47d2f79478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:27.122646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddd029-c9a6-4b69-8c8f-6a47d2f79478 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:27.124364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:27.125855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c920-3313-4845-b965-f5c53816fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:27.126685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c920-3313-4845-b965-f5c53816fda6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:27.126959 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c920-3313-4845-b965-f5c53816fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:27.127280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c920-3313-4845-b965-f5c53816fda6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:27.135384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 264/521] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:27.137097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddd029-c9a6-4b69-8c8f-6a47d2f79478 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:27.203995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0c920-3313-4845-b965-f5c53816fda6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:27.205598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0c920-3313-4845-b965-f5c53816fda6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:27.244442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddd029-c9a6-4b69-8c8f-6a47d2f79478 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:27.262494 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:27.282378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977f50b-4421-4e41-8cfd-b8ac5cafc837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:27.283059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977f50b-4421-4e41-8cfd-b8ac5cafc837 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:27.283345 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977f50b-4421-4e41-8cfd-b8ac5cafc837 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:27.283619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977f50b-4421-4e41-8cfd-b8ac5cafc837 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:27.284463 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977f50b-4421-4e41-8cfd-b8ac5cafc837 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:27.284810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977f50b-4421-4e41-8cfd-b8ac5cafc837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:27.286241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977f50b-4421-4e41-8cfd-b8ac5cafc837 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:27.309967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 258/522] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:27.309967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c920-3313-4845-b965-f5c53816fda6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:27.310782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 265/523] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Jul 14 09:05:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:27.311835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977f50b-4421-4e41-8cfd-b8ac5cafc837 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:27.368598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:27.421988 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977f50b-4421-4e41-8cfd-b8ac5cafc837 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:27.424456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c920-3313-4845-b965-f5c53816fda6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:27.458256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5c8eb-c449-4e91-9670-feef21551dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:27.459175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5c8eb-c449-4e91-9670-feef21551dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:27.459530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5c8eb-c449-4e91-9670-feef21551dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:27.459925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5c8eb-c449-4e91-9670-feef21551dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:27.461044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6575be-e0b4-4330-bdb6-cf281928314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:27.461711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6575be-e0b4-4330-bdb6-cf281928314a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:27.462001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6575be-e0b4-4330-bdb6-cf281928314a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:27.462278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6575be-e0b4-4330-bdb6-cf281928314a None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:27.463009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6575be-e0b4-4330-bdb6-cf281928314a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:27.463312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6575be-e0b4-4330-bdb6-cf281928314a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:27.464706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6575be-e0b4-4330-bdb6-cf281928314a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:27.467304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5c8eb-c449-4e91-9670-feef21551dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:27.468778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5c8eb-c449-4e91-9670-feef21551dd6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:27.476687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 259/524] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:27.481657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6575be-e0b4-4330-bdb6-cf281928314a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-39c5c8eb-c449-4e91-9670-feef21551dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:27.483818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:27.484801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:27.485641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:27.485641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:27.485641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:27.485641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:27.485641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:27.485641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:27.485641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:27.485641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:27.485641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 266/525] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:27.486636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5c8eb-c449-4e91-9670-feef21551dd6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:27.506297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:27.589223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6575be-e0b4-4330-bdb6-cf281928314a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:27.591626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5c8eb-c449-4e91-9670-feef21551dd6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:27.605297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:27.624815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528fc00-c152-499c-8b26-ffb239515267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:27.625467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528fc00-c152-499c-8b26-ffb239515267 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:27.625755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528fc00-c152-499c-8b26-ffb239515267 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:27.626029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528fc00-c152-499c-8b26-ffb239515267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:27.628906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a8ba2-bceb-46d6-ab94-785751c56197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:27.629652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8ba2-bceb-46d6-ab94-785751c56197 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:27.629939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8ba2-bceb-46d6-ab94-785751c56197 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:27.630215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8ba2-bceb-46d6-ab94-785751c56197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:27.641418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a8ba2-bceb-46d6-ab94-785751c56197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:27.642884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a8ba2-bceb-46d6-ab94-785751c56197 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5c6a8ba2-bceb-46d6-ab94-785751c56197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:27.659961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:27.660958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:27.661803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:27.661803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:27.661803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:27.661803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:27.661803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 267/526] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:27.662077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a8ba2-bceb-46d6-ab94-785751c56197 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:27.706753 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528fc00-c152-499c-8b26-ffb239515267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:27.708528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528fc00-c152-499c-8b26-ffb239515267 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:27.726984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:27.766022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a8ba2-bceb-46d6-ab94-785751c56197 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:27.800436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045dd6f-8321-4e06-bae5-420a21faaf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:27.801263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045dd6f-8321-4e06-bae5-420a21faaf73 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:27.801548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045dd6f-8321-4e06-bae5-420a21faaf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:27.801821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045dd6f-8321-4e06-bae5-420a21faaf73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:27.808883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045dd6f-8321-4e06-bae5-420a21faaf73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:27.810349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045dd6f-8321-4e06-bae5-420a21faaf73 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:27.820065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 260/527] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:27.820065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528fc00-c152-499c-8b26-ffb239515267 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2045dd6f-8321-4e06-bae5-420a21faaf73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:27.828982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:27.829800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:27.830734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:27.830734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:27.830734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:27.830734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:27.830734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:27.830734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:27.830734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:27.830734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:27.830734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 268/528] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:27.831776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045dd6f-8321-4e06-bae5-420a21faaf73 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:27.859485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:27.923918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528fc00-c152-499c-8b26-ffb239515267 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:27.939296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045dd6f-8321-4e06-bae5-420a21faaf73 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:27.941065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:27.962541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e003c-0934-4ca0-805e-950f23f0c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:27.963210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e003c-0934-4ca0-805e-950f23f0c36d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:27.963497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e003c-0934-4ca0-805e-950f23f0c36d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:27.963773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e003c-0934-4ca0-805e-950f23f0c36d None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:27.964563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e003c-0934-4ca0-805e-950f23f0c36d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:27.964894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e003c-0934-4ca0-805e-950f23f0c36d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:27.966333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e003c-0934-4ca0-805e-950f23f0c36d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:27.976334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad72732-9b7e-41ce-b241-e640ad7251c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:27.977105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad72732-9b7e-41ce-b241-e640ad7251c0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:27.977697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad72732-9b7e-41ce-b241-e640ad7251c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:27.977697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad72732-9b7e-41ce-b241-e640ad7251c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:27.978307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad72732-9b7e-41ce-b241-e640ad7251c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:27.978612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad72732-9b7e-41ce-b241-e640ad7251c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:27.979977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad72732-9b7e-41ce-b241-e640ad7251c0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:27.985118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 261/529] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:27.985732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e003c-0934-4ca0-805e-950f23f0c36d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:27.997621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 269/530] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:27.999307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad72732-9b7e-41ce-b241-e640ad7251c0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:28.088416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e003c-0934-4ca0-805e-950f23f0c36d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:28.092561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:28.111713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad72732-9b7e-41ce-b241-e640ad7251c0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:28.124472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca23a8-8df3-46de-8e8b-3d27ac7b76b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:28.125395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca23a8-8df3-46de-8e8b-3d27ac7b76b7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.125714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca23a8-8df3-46de-8e8b-3d27ac7b76b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.125988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca23a8-8df3-46de-8e8b-3d27ac7b76b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.137773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca23a8-8df3-46de-8e8b-3d27ac7b76b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:28.139381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca23a8-8df3-46de-8e8b-3d27ac7b76b7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:28.154588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b002c8f-f015-4161-971c-7d1d914c991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:28.155256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b002c8f-f015-4161-971c-7d1d914c991e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.155570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b002c8f-f015-4161-971c-7d1d914c991e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.155847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b002c8f-f015-4161-971c-7d1d914c991e None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.156643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b002c8f-f015-4161-971c-7d1d914c991e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:28.156981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b002c8f-f015-4161-971c-7d1d914c991e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:28.158410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b002c8f-f015-4161-971c-7d1d914c991e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-baca23a8-8df3-46de-8e8b-3d27ac7b76b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:28.158880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:28.159682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:28.161289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:28.161289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:28.161289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:28.161289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:28.161289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 262/531] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:28.161289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca23a8-8df3-46de-8e8b-3d27ac7b76b7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:28.183813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 270/532] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:28.184591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b002c8f-f015-4161-971c-7d1d914c991e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:28.195047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:28.271173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca23a8-8df3-46de-8e8b-3d27ac7b76b7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:28.297759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b002c8f-f015-4161-971c-7d1d914c991e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:28.306921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa6c9-9468-4eef-8685-6e39df4c6a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:28.307595 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa6c9-9468-4eef-8685-6e39df4c6a93 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.307875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa6c9-9468-4eef-8685-6e39df4c6a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.308152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa6c9-9468-4eef-8685-6e39df4c6a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.309023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fa6c9-9468-4eef-8685-6e39df4c6a93 None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=ebf4ab9d717e4c838d68590336074f09) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:28.309335 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fa6c9-9468-4eef-8685-6e39df4c6a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:28.310842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fa6c9-9468-4eef-8685-6e39df4c6a93 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:28.317109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 263/533] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:28 2022] GET /identity/v3/role_assignments?user.id=ebf4ab9d717e4c838d68590336074f09&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:28.317922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa6c9-9468-4eef-8685-6e39df4c6a93 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:28.359088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a763b89-c0e6-4838-bb81-75a7b5742c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:28.361652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a763b89-c0e6-4838-bb81-75a7b5742c76 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.362176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a763b89-c0e6-4838-bb81-75a7b5742c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.362648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a763b89-c0e6-4838-bb81-75a7b5742c76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.372996 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a763b89-c0e6-4838-bb81-75a7b5742c76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:28.374869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a763b89-c0e6-4838-bb81-75a7b5742c76 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-3a763b89-c0e6-4838-bb81-75a7b5742c76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:28.398954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:28.399865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:28.400738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:28.400738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:28.400738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:28.400738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:28.400738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:28.400738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:28.400738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:28.400738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:28.407936 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 271/534] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:28.407936 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a763b89-c0e6-4838-bb81-75a7b5742c76 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:28.410817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:28.446977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:28.458845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa6c9-9468-4eef-8685-6e39df4c6a93 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:28.498830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f639d26-ed7a-4593-b786-0af4e0372749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:28.499755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f639d26-ed7a-4593-b786-0af4e0372749 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.500040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f639d26-ed7a-4593-b786-0af4e0372749 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.500314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f639d26-ed7a-4593-b786-0af4e0372749 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.501074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f639d26-ed7a-4593-b786-0af4e0372749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:28.501381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f639d26-ed7a-4593-b786-0af4e0372749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:28.503384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f639d26-ed7a-4593-b786-0af4e0372749 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:28.516118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 264/535] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:28.517522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f639d26-ed7a-4593-b786-0af4e0372749 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:28.541724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a763b89-c0e6-4838-bb81-75a7b5742c76 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:28.578983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e9c9d-67f9-4a32-a069-bc8331368eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:28.579650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e9c9d-67f9-4a32-a069-bc8331368eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.579935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e9c9d-67f9-4a32-a069-bc8331368eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.580208 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e9c9d-67f9-4a32-a069-bc8331368eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.581078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e9c9d-67f9-4a32-a069-bc8331368eb5 None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=66f1d95bcc534f4e945fc2c5be046a5f) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:28.581403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e9c9d-67f9-4a32-a069-bc8331368eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:28.582823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e9c9d-67f9-4a32-a069-bc8331368eb5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:28.589383 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 272/536] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:28 2022] GET /identity/v3/role_assignments?user.id=66f1d95bcc534f4e945fc2c5be046a5f&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:28.590426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b71705-f11a-4cde-8f04-499609b3f64d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.590712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b71705-f11a-4cde-8f04-499609b3f64d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.590989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b71705-f11a-4cde-8f04-499609b3f64d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.592386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 273/537] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:28.592974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b71705-f11a-4cde-8f04-499609b3f64d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:28.646822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f639d26-ed7a-4593-b786-0af4e0372749 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:28.681066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:28.691171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559398fb-dd89-4bc4-a49f-33446f78d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:28.692362 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559398fb-dd89-4bc4-a49f-33446f78d5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.692875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559398fb-dd89-4bc4-a49f-33446f78d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.693358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559398fb-dd89-4bc4-a49f-33446f78d5d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.694432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559398fb-dd89-4bc4-a49f-33446f78d5d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:28.694946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559398fb-dd89-4bc4-a49f-33446f78d5d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:28.696764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559398fb-dd89-4bc4-a49f-33446f78d5d0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:28.711406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 265/538] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:28.713331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed22d-f67d-4f8b-966a-64b16dcc6227 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.713818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed22d-f67d-4f8b-966a-64b16dcc6227 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.714304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed22d-f67d-4f8b-966a-64b16dcc6227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.729766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b71705-f11a-4cde-8f04-499609b3f64d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:28.734702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-baaed22d-f67d-4f8b-966a-64b16dcc6227 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:28.736564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-baaed22d-f67d-4f8b-966a-64b16dcc6227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:28.748036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:28.786700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2f0aa-8de3-47bb-952b-3a212daa8fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:28.788921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2f0aa-8de3-47bb-952b-3a212daa8fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.789466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2f0aa-8de3-47bb-952b-3a212daa8fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.789960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2f0aa-8de3-47bb-952b-3a212daa8fd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.799309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2f0aa-8de3-47bb-952b-3a212daa8fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:28.801437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2f0aa-8de3-47bb-952b-3a212daa8fd7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-cee2f0aa-8de3-47bb-952b-3a212daa8fd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:28.820353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:28.821382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:28.822242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:28.822242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:28.822242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:28.822242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:28.822242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:28.822242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:28.822242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:28.822242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:28.826730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 274/539] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:28.827942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2f0aa-8de3-47bb-952b-3a212daa8fd7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:28.833000 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 266/540] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:28.834165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed22d-f67d-4f8b-966a-64b16dcc6227 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:28.948726 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2f0aa-8de3-47bb-952b-3a212daa8fd7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:28.962856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed22d-f67d-4f8b-966a-64b16dcc6227 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:28.979654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:28.989592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7e6fb-6082-4ce0-ad84-bd8df4ac39f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:28.990496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7e6fb-6082-4ce0-ad84-bd8df4ac39f4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:28.991054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7e6fb-6082-4ce0-ad84-bd8df4ac39f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:28.991549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7e6fb-6082-4ce0-ad84-bd8df4ac39f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:28.992576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7e6fb-6082-4ce0-ad84-bd8df4ac39f4 None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=4f9b12f6e7e347e19e5183d7e45b162f) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:28.993105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7e6fb-6082-4ce0-ad84-bd8df4ac39f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:28.994729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7e6fb-6082-4ce0-ad84-bd8df4ac39f4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:29.001147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 275/541] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:28 2022] GET /identity/v3/role_assignments?user.id=4f9b12f6e7e347e19e5183d7e45b162f&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:29.002272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7e6fb-6082-4ce0-ad84-bd8df4ac39f4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:29.021341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a0176-1f71-4080-ba30-6908a32c9994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:29.022509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a0176-1f71-4080-ba30-6908a32c9994 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:29.023441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a0176-1f71-4080-ba30-6908a32c9994 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:29.023911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a0176-1f71-4080-ba30-6908a32c9994 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:29.025701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a0176-1f71-4080-ba30-6908a32c9994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:29.026028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a0176-1f71-4080-ba30-6908a32c9994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:29.027565 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a0176-1f71-4080-ba30-6908a32c9994 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:29.048780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 267/542] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:29.053279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a0176-1f71-4080-ba30-6908a32c9994 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:29.059350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:29.205861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a0176-1f71-4080-ba30-6908a32c9994 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:29.233659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7e6fb-6082-4ce0-ad84-bd8df4ac39f4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:29.262314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85123-eca3-4631-bdd9-a9b3851beee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:29.262990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85123-eca3-4631-bdd9-a9b3851beee7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:29.263275 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85123-eca3-4631-bdd9-a9b3851beee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:29.263553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85123-eca3-4631-bdd9-a9b3851beee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:29.264404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85123-eca3-4631-bdd9-a9b3851beee7 None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=60db5d8bc4cb4ce7af8bfac2c4eb2390) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:29.264741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85123-eca3-4631-bdd9-a9b3851beee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:29.266206 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85123-eca3-4631-bdd9-a9b3851beee7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:29.281931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 268/543] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:29 2022] GET /identity/v3/role_assignments?user.id=60db5d8bc4cb4ce7af8bfac2c4eb2390&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:29.300541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57767ebf-e2f9-42e5-8d1e-54ee424a8156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:29.301406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57767ebf-e2f9-42e5-8d1e-54ee424a8156 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:29.301692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57767ebf-e2f9-42e5-8d1e-54ee424a8156 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:29.302009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57767ebf-e2f9-42e5-8d1e-54ee424a8156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:29.319537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57767ebf-e2f9-42e5-8d1e-54ee424a8156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-57767ebf-e2f9-42e5-8d1e-54ee424a8156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:29.327752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:29.328747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:29.329546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:29.337368 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 276/544] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:29.343846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85123-eca3-4631-bdd9-a9b3851beee7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:29.459052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:29.503423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85123-eca3-4631-bdd9-a9b3851beee7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:29.546729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd17166-bb5f-48ae-bb41-ffa525aa4f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:29.547410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17166-bb5f-48ae-bb41-ffa525aa4f8a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:29.547694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17166-bb5f-48ae-bb41-ffa525aa4f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:29.547969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17166-bb5f-48ae-bb41-ffa525aa4f8a None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:29.548762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd17166-bb5f-48ae-bb41-ffa525aa4f8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:29.549070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd17166-bb5f-48ae-bb41-ffa525aa4f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:29.550438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd17166-bb5f-48ae-bb41-ffa525aa4f8a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:29.564455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 269/545] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:29.570042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57767ebf-e2f9-42e5-8d1e-54ee424a8156 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:29.646581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:29.708978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57767ebf-e2f9-42e5-8d1e-54ee424a8156 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:29.743232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c399d-3160-4e86-906f-211ed61ac82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:29.744032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c399d-3160-4e86-906f-211ed61ac82a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:29.744307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c399d-3160-4e86-906f-211ed61ac82a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:29.744576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c399d-3160-4e86-906f-211ed61ac82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:29.756295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c399d-3160-4e86-906f-211ed61ac82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:29.757708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c399d-3160-4e86-906f-211ed61ac82a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-db1c399d-3160-4e86-906f-211ed61ac82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:29.775023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:29.775871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:29.777162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:29.777162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:29.777162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:29.777162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:29.777162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 277/546] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:29.782046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd17166-bb5f-48ae-bb41-ffa525aa4f8a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:29.885297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd17166-bb5f-48ae-bb41-ffa525aa4f8a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:29.917043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:29.921017 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071e9fe-90f7-449e-b6c4-5f34cd7ca660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:29.921691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071e9fe-90f7-449e-b6c4-5f34cd7ca660 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:29.922001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071e9fe-90f7-449e-b6c4-5f34cd7ca660 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:29.922233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071e9fe-90f7-449e-b6c4-5f34cd7ca660 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:29.922962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071e9fe-90f7-449e-b6c4-5f34cd7ca660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:29.923638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071e9fe-90f7-449e-b6c4-5f34cd7ca660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:29.925387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071e9fe-90f7-449e-b6c4-5f34cd7ca660 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:29.938289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 270/547] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:29.943645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c399d-3160-4e86-906f-211ed61ac82a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:30.045111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c399d-3160-4e86-906f-211ed61ac82a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:30.049066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:30.079740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357b80-bb57-44ad-b974-1a78a99b6393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:30.080546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357b80-bb57-44ad-b974-1a78a99b6393 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:30.080865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357b80-bb57-44ad-b974-1a78a99b6393 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:30.081137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357b80-bb57-44ad-b974-1a78a99b6393 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:30.089254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357b80-bb57-44ad-b974-1a78a99b6393 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:30.090697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357b80-bb57-44ad-b974-1a78a99b6393 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-59357b80-bb57-44ad-b974-1a78a99b6393 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:30.105294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:30.106313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:30.107705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 278/548] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:30.112344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071e9fe-90f7-449e-b6c4-5f34cd7ca660 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:30.217664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071e9fe-90f7-449e-b6c4-5f34cd7ca660 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:30.251847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7993f8-c4b5-4aed-9e8a-0fd72a5ea9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:30.252517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7993f8-c4b5-4aed-9e8a-0fd72a5ea9dc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:30.252824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7993f8-c4b5-4aed-9e8a-0fd72a5ea9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:30.253095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7993f8-c4b5-4aed-9e8a-0fd72a5ea9dc None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:30.253933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7993f8-c4b5-4aed-9e8a-0fd72a5ea9dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:30.254239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7993f8-c4b5-4aed-9e8a-0fd72a5ea9dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:30.255772 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7993f8-c4b5-4aed-9e8a-0fd72a5ea9dc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:30.273472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 271/549] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jul 14 09:05:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:30.278973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357b80-bb57-44ad-b974-1a78a99b6393 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:30.381226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357b80-bb57-44ad-b974-1a78a99b6393 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:30.415433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6a559-18c4-439e-96e0-fc2ea0c87a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:30.416089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6a559-18c4-439e-96e0-fc2ea0c87a01 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:30.416369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6a559-18c4-439e-96e0-fc2ea0c87a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:30.416642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6a559-18c4-439e-96e0-fc2ea0c87a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:30.449738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:30.500146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6a559-18c4-439e-96e0-fc2ea0c87a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:30.501656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6a559-18c4-439e-96e0-fc2ea0c87a01 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:30.624299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 279/550] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:30.629854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7993f8-c4b5-4aed-9e8a-0fd72a5ea9dc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:30.678118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:30.732629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7993f8-c4b5-4aed-9e8a-0fd72a5ea9dc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:30.767897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e17a93-7262-45f8-807e-9ac8e8622de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:30.768712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e17a93-7262-45f8-807e-9ac8e8622de3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:30.768988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e17a93-7262-45f8-807e-9ac8e8622de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:30.769258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e17a93-7262-45f8-807e-9ac8e8622de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:30.779909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e17a93-7262-45f8-807e-9ac8e8622de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:30.781450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e17a93-7262-45f8-807e-9ac8e8622de3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-04e17a93-7262-45f8-807e-9ac8e8622de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:30.799541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:30.800976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:30.801953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:30.801953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:30.801953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:30.801953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:30.801953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 272/551] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:30.806786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6a559-18c4-439e-96e0-fc2ea0c87a01 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:30.870094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:30.890814 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8c6c9-07d3-48b2-b03a-02641d5bc711 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:30.891004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8c6c9-07d3-48b2-b03a-02641d5bc711 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:30.891266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8c6c9-07d3-48b2-b03a-02641d5bc711 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:30.892637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 273/552] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:05:30.898021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921409e7-627c-477e-baae-8895434b06e8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:30.898302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921409e7-627c-477e-baae-8895434b06e8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:30.898571 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921409e7-627c-477e-baae-8895434b06e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:30.919039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-921409e7-627c-477e-baae-8895434b06e8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:30.920484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-921409e7-627c-477e-baae-8895434b06e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:30.928513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6a559-18c4-439e-96e0-fc2ea0c87a01 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:30.994386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 274/553] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:31.006339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e408cb-3d7d-4332-96de-96ec5be23721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:31.007063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e408cb-3d7d-4332-96de-96ec5be23721 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.007347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e408cb-3d7d-4332-96de-96ec5be23721 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.007620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e408cb-3d7d-4332-96de-96ec5be23721 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.008350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e408cb-3d7d-4332-96de-96ec5be23721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:31.008650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e408cb-3d7d-4332-96de-96ec5be23721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:31.010061 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e408cb-3d7d-4332-96de-96ec5be23721 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:31.018192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921409e7-627c-477e-baae-8895434b06e8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:31.028038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 280/554] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:31.033065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e408cb-3d7d-4332-96de-96ec5be23721 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:31.048296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:31.121211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921409e7-627c-477e-baae-8895434b06e8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:31.171101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75748577-8186-491b-8f0d-6561a06e4827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:31.171827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75748577-8186-491b-8f0d-6561a06e4827 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.172101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75748577-8186-491b-8f0d-6561a06e4827 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.172369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75748577-8186-491b-8f0d-6561a06e4827 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.196845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75748577-8186-491b-8f0d-6561a06e4827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-75748577-8186-491b-8f0d-6561a06e4827 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:31.204493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:31.205442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:31.206289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 275/555] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:31.226302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75748577-8186-491b-8f0d-6561a06e4827 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:31.254289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e408cb-3d7d-4332-96de-96ec5be23721 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:31.279386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:31.292906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389dda-0d7e-4383-9228-a2af3739bbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:31.293782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389dda-0d7e-4383-9228-a2af3739bbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.294070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389dda-0d7e-4383-9228-a2af3739bbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.294344 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389dda-0d7e-4383-9228-a2af3739bbc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.303622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389dda-0d7e-4383-9228-a2af3739bbc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:31.305099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389dda-0d7e-4383-9228-a2af3739bbc6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5a389dda-0d7e-4383-9228-a2af3739bbc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:31.320453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:31.321405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:31.322870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:31.322870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:31.322870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:31.322870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:31.322870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:31.322870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:31.322870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:31.322870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:31.326457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 281/556] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:31.327872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d055db3-c121-4aa0-945b-847c920b9d7d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.328208 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d055db3-c121-4aa0-945b-847c920b9d7d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.328570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d055db3-c121-4aa0-945b-847c920b9d7d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.329997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 282/557] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:31.333009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:31.334938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d055db3-c121-4aa0-945b-847c920b9d7d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:31.348301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75748577-8186-491b-8f0d-6561a06e4827 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:31.401583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e280161-9615-4b99-af81-b0ad2f502741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:31.402411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280161-9615-4b99-af81-b0ad2f502741 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.402797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280161-9615-4b99-af81-b0ad2f502741 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.403175 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280161-9615-4b99-af81-b0ad2f502741 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.404343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e280161-9615-4b99-af81-b0ad2f502741 None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:31.404343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e280161-9615-4b99-af81-b0ad2f502741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:31.405941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e280161-9615-4b99-af81-b0ad2f502741 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:31.420082 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 276/558] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:31.421715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0781b-2a06-4fa5-a50c-11ebf81cd1f8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.422056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0781b-2a06-4fa5-a50c-11ebf81cd1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.422438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0781b-2a06-4fa5-a50c-11ebf81cd1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.439724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a0e0781b-2a06-4fa5-a50c-11ebf81cd1f8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:31.441105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a0e0781b-2a06-4fa5-a50c-11ebf81cd1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:31.457122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d055db3-c121-4aa0-945b-847c920b9d7d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:31.494460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b7c71-3483-408b-a38d-051faf87e707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:31.495407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b7c71-3483-408b-a38d-051faf87e707 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.495684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b7c71-3483-408b-a38d-051faf87e707 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.495952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b7c71-3483-408b-a38d-051faf87e707 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.496767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b7c71-3483-408b-a38d-051faf87e707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:31.497073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b7c71-3483-408b-a38d-051faf87e707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:31.498489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b7c71-3483-408b-a38d-051faf87e707 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:31.512713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 283/559] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:31.512713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b7c71-3483-408b-a38d-051faf87e707 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:31.515845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 277/560] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:31.517279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec09212-48f2-46c6-9033-15f1b011ccdf None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.517570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec09212-48f2-46c6-9033-15f1b011ccdf None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.517853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec09212-48f2-46c6-9033-15f1b011ccdf None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.519244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 278/561] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:31.523556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec09212-48f2-46c6-9033-15f1b011ccdf None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:31.575673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:31.612597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:31.633532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec09212-48f2-46c6-9033-15f1b011ccdf None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:31.640377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b7c71-3483-408b-a38d-051faf87e707 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:31.675519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e94f34-b010-4469-b6d7-96669f389323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:31.676559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e94f34-b010-4469-b6d7-96669f389323 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.676970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911804-998e-4473-9507-87b95e3c45d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:31.677247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e94f34-b010-4469-b6d7-96669f389323 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.677748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e94f34-b010-4469-b6d7-96669f389323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.677961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911804-998e-4473-9507-87b95e3c45d2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.678291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911804-998e-4473-9507-87b95e3c45d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.678550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911804-998e-4473-9507-87b95e3c45d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.679530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e94f34-b010-4469-b6d7-96669f389323 None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=2dab40ef1f8d4f5abf10b92e99e04122) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:31.679995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e94f34-b010-4469-b6d7-96669f389323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:31.682149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e94f34-b010-4469-b6d7-96669f389323 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:31.696707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 279/562] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:31 2022] GET /identity/v3/role_assignments?user.id=2dab40ef1f8d4f5abf10b92e99e04122&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:31.696707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb892e7-6603-49dc-89bb-1aff4cadbf79 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.696707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb892e7-6603-49dc-89bb-1aff4cadbf79 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.696707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb892e7-6603-49dc-89bb-1aff4cadbf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.698718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56911804-998e-4473-9507-87b95e3c45d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:31.700323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56911804-998e-4473-9507-87b95e3c45d2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:31.709043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9eb892e7-6603-49dc-89bb-1aff4cadbf79 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:31.710251 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9eb892e7-6603-49dc-89bb-1aff4cadbf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-56911804-998e-4473-9507-87b95e3c45d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:31.720218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:31.721204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:31.722170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:31.722170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:31.722170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:31.722170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:31.726474 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 284/563] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:31.727468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911804-998e-4473-9507-87b95e3c45d2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:31.787605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 280/564] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:31.788588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb892e7-6603-49dc-89bb-1aff4cadbf79 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:31.840682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:31.848139 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911804-998e-4473-9507-87b95e3c45d2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:31.882059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:31.885722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c48f8-760b-472e-905b-e313eb5b2c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:31.886538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c48f8-760b-472e-905b-e313eb5b2c25 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.886817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c48f8-760b-472e-905b-e313eb5b2c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.887095 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c48f8-760b-472e-905b-e313eb5b2c25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.898115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c48f8-760b-472e-905b-e313eb5b2c25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2f3c48f8-760b-472e-905b-e313eb5b2c25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:31.905823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:31.906750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:31.907631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 285/565] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:31.909149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be56f1-f143-4f7a-b49e-169daacd252d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.909149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be56f1-f143-4f7a-b49e-169daacd252d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.909149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be56f1-f143-4f7a-b49e-169daacd252d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.910247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 286/566] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:31.915117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb892e7-6603-49dc-89bb-1aff4cadbf79 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:31.915244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be56f1-f143-4f7a-b49e-169daacd252d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:31.951768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611188c-16bd-4d24-a793-1996ea4dde29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:31.952373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611188c-16bd-4d24-a793-1996ea4dde29 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:31.952675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611188c-16bd-4d24-a793-1996ea4dde29 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:31.952961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611188c-16bd-4d24-a793-1996ea4dde29 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:31.953708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611188c-16bd-4d24-a793-1996ea4dde29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:31.954017 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611188c-16bd-4d24-a793-1996ea4dde29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:31.955398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611188c-16bd-4d24-a793-1996ea4dde29 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:31.971925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 281/567] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:31.971925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611188c-16bd-4d24-a793-1996ea4dde29 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.026502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be56f1-f143-4f7a-b49e-169daacd252d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.063478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c41d5-5bf2-4159-b6a0-7ef0ed8ca51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:32.064284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c41d5-5bf2-4159-b6a0-7ef0ed8ca51c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.064574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c41d5-5bf2-4159-b6a0-7ef0ed8ca51c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.064853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c41d5-5bf2-4159-b6a0-7ef0ed8ca51c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.075684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c41d5-5bf2-4159-b6a0-7ef0ed8ca51c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2c8c41d5-5bf2-4159-b6a0-7ef0ed8ca51c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:32.083683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:32.084654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:32.085838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 287/568] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:32.086551 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611188c-16bd-4d24-a793-1996ea4dde29 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.086627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47693c-00df-40ee-93ac-8a7d8146c514 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.086627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47693c-00df-40ee-93ac-8a7d8146c514 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.086773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47693c-00df-40ee-93ac-8a7d8146c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.105266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cd47693c-00df-40ee-93ac-8a7d8146c514 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:32.106470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cd47693c-00df-40ee-93ac-8a7d8146c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:32.119164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:32.128181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a8881-c725-4fff-8600-798ba4d2f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:32.128881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a8881-c725-4fff-8600-798ba4d2f395 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.129170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a8881-c725-4fff-8600-798ba4d2f395 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.129438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a8881-c725-4fff-8600-798ba4d2f395 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.130202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a8881-c725-4fff-8600-798ba4d2f395 None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:32.130546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a8881-c725-4fff-8600-798ba4d2f395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:32.132032 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a8881-c725-4fff-8600-798ba4d2f395 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:32.133660 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:32.149004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 282/569] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:32.150213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a8881-c725-4fff-8600-798ba4d2f395 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.188695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 288/570] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:32.188695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47693c-00df-40ee-93ac-8a7d8146c514 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.264796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a8881-c725-4fff-8600-798ba4d2f395 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.285798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47693c-00df-40ee-93ac-8a7d8146c514 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.300112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af811ca-49ca-4f69-8483-d8193309a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:32.300954 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af811ca-49ca-4f69-8483-d8193309a941 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.301239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af811ca-49ca-4f69-8483-d8193309a941 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.301528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af811ca-49ca-4f69-8483-d8193309a941 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.309462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af811ca-49ca-4f69-8483-d8193309a941 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:32.311034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af811ca-49ca-4f69-8483-d8193309a941 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:32.323125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53f94f-3322-494b-a28c-ad898f469b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:32.323801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53f94f-3322-494b-a28c-ad898f469b49 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.324083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53f94f-3322-494b-a28c-ad898f469b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.324354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53f94f-3322-494b-a28c-ad898f469b49 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.325149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53f94f-3322-494b-a28c-ad898f469b49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:32.325457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53f94f-3322-494b-a28c-ad898f469b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:32.326832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53f94f-3322-494b-a28c-ad898f469b49 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-5af811ca-49ca-4f69-8483-d8193309a941 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:32.327428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:32.328332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:32.329328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 283/571] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:32.330515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af811ca-49ca-4f69-8483-d8193309a941 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.345591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 289/572] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:32.345591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53f94f-3322-494b-a28c-ad898f469b49 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.352845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:32.397055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:32.445350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af811ca-49ca-4f69-8483-d8193309a941 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.453036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53f94f-3322-494b-a28c-ad898f469b49 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.481646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f769c-efeb-4073-aaff-70f6bfe3bd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:32.482473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f769c-efeb-4073-aaff-70f6bfe3bd30 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.482750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f769c-efeb-4073-aaff-70f6bfe3bd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.483183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f769c-efeb-4073-aaff-70f6bfe3bd30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.487696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74144e51-bf7b-46a8-9a85-2ee40694c24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:32.488491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74144e51-bf7b-46a8-9a85-2ee40694c24c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.488813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74144e51-bf7b-46a8-9a85-2ee40694c24c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.489083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74144e51-bf7b-46a8-9a85-2ee40694c24c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.493776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f769c-efeb-4073-aaff-70f6bfe3bd30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:32.495222 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f769c-efeb-4073-aaff-70f6bfe3bd30 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:32.499679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74144e51-bf7b-46a8-9a85-2ee40694c24c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-74144e51-bf7b-46a8-9a85-2ee40694c24c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:32.507493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:32.508417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 290/573] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:32.509878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74144e51-bf7b-46a8-9a85-2ee40694c24c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-bc3f769c-efeb-4073-aaff-70f6bfe3bd30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:32.516860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:32.517723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:32.518610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:32.518610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:32.518610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:32.518610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:32.518610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 284/574] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:32.523717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f769c-efeb-4073-aaff-70f6bfe3bd30 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.580316 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:32.615985 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74144e51-bf7b-46a8-9a85-2ee40694c24c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.635798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f769c-efeb-4073-aaff-70f6bfe3bd30 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.646263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:32.652058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd36482-f1da-4a8a-b521-257079133fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:32.652452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd36482-f1da-4a8a-b521-257079133fef None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.652767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd36482-f1da-4a8a-b521-257079133fef None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.653052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd36482-f1da-4a8a-b521-257079133fef None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.653901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd36482-f1da-4a8a-b521-257079133fef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:32.654216 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd36482-f1da-4a8a-b521-257079133fef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:32.655660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd36482-f1da-4a8a-b521-257079133fef None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:32.673390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491f6a0-745c-4d63-9f65-b63bb9110b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:32.674197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491f6a0-745c-4d63-9f65-b63bb9110b04 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.674481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491f6a0-745c-4d63-9f65-b63bb9110b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.674757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491f6a0-745c-4d63-9f65-b63bb9110b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.680500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 291/575] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jul 14 09:05:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:32.680500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd36482-f1da-4a8a-b521-257079133fef None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.685269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491f6a0-745c-4d63-9f65-b63bb9110b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:32.686738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491f6a0-745c-4d63-9f65-b63bb9110b04 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-b491f6a0-745c-4d63-9f65-b63bb9110b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:32.704932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:32.705842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:32.706796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:32.706796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:32.706796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:32.706796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:32.706796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 285/576] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:32.707076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491f6a0-745c-4d63-9f65-b63bb9110b04 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.796060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd36482-f1da-4a8a-b521-257079133fef None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.820366 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491f6a0-745c-4d63-9f65-b63bb9110b04 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.823270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:32.833753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f3148-e06e-4d8f-b3d5-c7f67db71a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:32.834434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f3148-e06e-4d8f-b3d5-c7f67db71a1f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.834722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f3148-e06e-4d8f-b3d5-c7f67db71a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.835000 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f3148-e06e-4d8f-b3d5-c7f67db71a1f None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.835761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f3148-e06e-4d8f-b3d5-c7f67db71a1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:32.836126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f3148-e06e-4d8f-b3d5-c7f67db71a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:32.837559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f3148-e06e-4d8f-b3d5-c7f67db71a1f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:32.852106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 292/577] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:32.852106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f3148-e06e-4d8f-b3d5-c7f67db71a1f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.861762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e513e3-6d14-4266-bf8f-981f7a327323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:32.862435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e513e3-6d14-4266-bf8f-981f7a327323 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:32.862730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e513e3-6d14-4266-bf8f-981f7a327323 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:32.863134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e513e3-6d14-4266-bf8f-981f7a327323 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:32.863831 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e513e3-6d14-4266-bf8f-981f7a327323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:32.864136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e513e3-6d14-4266-bf8f-981f7a327323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:32.865788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e513e3-6d14-4266-bf8f-981f7a327323 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:32.878723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 286/578] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:32.879539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e513e3-6d14-4266-bf8f-981f7a327323 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:32.903959 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:32.962600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f3148-e06e-4d8f-b3d5-c7f67db71a1f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:32.999358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be621657-2920-4b68-9a3a-32e5ec0db915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.000160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be621657-2920-4b68-9a3a-32e5ec0db915 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.000448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be621657-2920-4b68-9a3a-32e5ec0db915 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.000750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be621657-2920-4b68-9a3a-32e5ec0db915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.005414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e513e3-6d14-4266-bf8f-981f7a327323 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.013526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be621657-2920-4b68-9a3a-32e5ec0db915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.014990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be621657-2920-4b68-9a3a-32e5ec0db915 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-be621657-2920-4b68-9a3a-32e5ec0db915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:33.032844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:33.034181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:33.035081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:33.035081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:33.035081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:33.035081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:33.035081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 293/579] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:33.035081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be621657-2920-4b68-9a3a-32e5ec0db915 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.045005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeccab4-cc4d-4bfb-85dc-1505873362fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.045681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeccab4-cc4d-4bfb-85dc-1505873362fa None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.045965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeccab4-cc4d-4bfb-85dc-1505873362fa None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.046299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeccab4-cc4d-4bfb-85dc-1505873362fa None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.046980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeccab4-cc4d-4bfb-85dc-1505873362fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:33.047288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeccab4-cc4d-4bfb-85dc-1505873362fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.048655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeccab4-cc4d-4bfb-85dc-1505873362fa None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.061085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 287/580] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:33.061891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeccab4-cc4d-4bfb-85dc-1505873362fa None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.088502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:33.148642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:33.149870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be621657-2920-4b68-9a3a-32e5ec0db915 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.171594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeccab4-cc4d-4bfb-85dc-1505873362fa None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.184241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989289b-d227-45f2-8305-307e82e5c363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.185087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989289b-d227-45f2-8305-307e82e5c363 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.185370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989289b-d227-45f2-8305-307e82e5c363 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.185644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989289b-d227-45f2-8305-307e82e5c363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.196393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989289b-d227-45f2-8305-307e82e5c363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.197872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989289b-d227-45f2-8305-307e82e5c363 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.209746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff875-f5cd-411c-b8e0-ba6eb7a6a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.210744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff875-f5cd-411c-b8e0-ba6eb7a6a64a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.211177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff875-f5cd-411c-b8e0-ba6eb7a6a64a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.211636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff875-f5cd-411c-b8e0-ba6eb7a6a64a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b989289b-d227-45f2-8305-307e82e5c363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:33.215428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:33.216519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:33.217781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:33.217781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:33.217781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:33.217781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:33.221230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 294/581] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:33.221956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989289b-d227-45f2-8305-307e82e5c363 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.222573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff875-f5cd-411c-b8e0-ba6eb7a6a64a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.224227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff875-f5cd-411c-b8e0-ba6eb7a6a64a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f76ff875-f5cd-411c-b8e0-ba6eb7a6a64a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:33.240290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:33.241643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:33.242593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 288/582] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:33.243180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff875-f5cd-411c-b8e0-ba6eb7a6a64a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.333583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:33.342648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989289b-d227-45f2-8305-307e82e5c363 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.351811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff875-f5cd-411c-b8e0-ba6eb7a6a64a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.385583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6831a0a-a8e1-4a94-89b8-ebc85c150d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.386265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6831a0a-a8e1-4a94-89b8-ebc85c150d92 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.386550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6831a0a-a8e1-4a94-89b8-ebc85c150d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.386828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6831a0a-a8e1-4a94-89b8-ebc85c150d92 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.387546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6831a0a-a8e1-4a94-89b8-ebc85c150d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:33.387865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6831a0a-a8e1-4a94-89b8-ebc85c150d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.389276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6831a0a-a8e1-4a94-89b8-ebc85c150d92 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.394185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeeb56-2d12-4365-a85e-f558026acb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.395256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeeb56-2d12-4365-a85e-f558026acb29 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.395732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeeb56-2d12-4365-a85e-f558026acb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.396215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeeb56-2d12-4365-a85e-f558026acb29 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.401532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 295/583] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:33.402342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6831a0a-a8e1-4a94-89b8-ebc85c150d92 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.407215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adeeb56-2d12-4365-a85e-f558026acb29 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.409985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adeeb56-2d12-4365-a85e-f558026acb29 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.413427 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-7adeeb56-2d12-4365-a85e-f558026acb29 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:33.432795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:33.433860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:33.434832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:33.434832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:33.434832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:33.434832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:33.434832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:33.434832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:33.434832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:33.434832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:33.434832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:05:33.434832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:33.435384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 289/584] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:33.435947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeeb56-2d12-4365-a85e-f558026acb29 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.513947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6831a0a-a8e1-4a94-89b8-ebc85c150d92 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.547244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeeb56-2d12-4365-a85e-f558026acb29 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.550579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56f88-ff52-4053-827f-4f744f2b985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.551458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56f88-ff52-4053-827f-4f744f2b985b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.551951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56f88-ff52-4053-827f-4f744f2b985b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.552458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56f88-ff52-4053-827f-4f744f2b985b None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.553457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de56f88-ff52-4053-827f-4f744f2b985b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:33.553943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de56f88-ff52-4053-827f-4f744f2b985b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.555517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de56f88-ff52-4053-827f-4f744f2b985b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.567558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 296/585] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:33.572603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56f88-ff52-4053-827f-4f744f2b985b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.586717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a06f-70ae-4847-ab31-46b3d56defb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.587327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a06f-70ae-4847-ab31-46b3d56defb6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.587613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a06f-70ae-4847-ab31-46b3d56defb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.587888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a06f-70ae-4847-ab31-46b3d56defb6 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.588788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a06f-70ae-4847-ab31-46b3d56defb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:33.588919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:33.589099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a06f-70ae-4847-ab31-46b3d56defb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.590670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a06f-70ae-4847-ab31-46b3d56defb6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.608873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 290/586] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:33.609707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a06f-70ae-4847-ab31-46b3d56defb6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.673833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:33.685882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56f88-ff52-4053-827f-4f744f2b985b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.715814 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a06f-70ae-4847-ab31-46b3d56defb6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.719905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd35dc3-6d88-4b91-8784-9558e22bae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.720741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35dc3-6d88-4b91-8784-9558e22bae80 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.721028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35dc3-6d88-4b91-8784-9558e22bae80 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.721305 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35dc3-6d88-4b91-8784-9558e22bae80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.728189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd35dc3-6d88-4b91-8784-9558e22bae80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.729664 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd35dc3-6d88-4b91-8784-9558e22bae80 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-ccd35dc3-6d88-4b91-8784-9558e22bae80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:33.743844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:33.744805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:33.745705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:33.745705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:33.745705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:33.745705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:33.745705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:33.745705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:33.745705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:33.745705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:33.745705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 297/587] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:33.746183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd35dc3-6d88-4b91-8784-9558e22bae80 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.753352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90c7b0-bd57-452b-8b8e-c954965f776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.754021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90c7b0-bd57-452b-8b8e-c954965f776f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.754302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90c7b0-bd57-452b-8b8e-c954965f776f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.754573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90c7b0-bd57-452b-8b8e-c954965f776f None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.755464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90c7b0-bd57-452b-8b8e-c954965f776f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:33.755763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90c7b0-bd57-452b-8b8e-c954965f776f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.757207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90c7b0-bd57-452b-8b8e-c954965f776f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.774379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 291/588] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:33.775164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90c7b0-bd57-452b-8b8e-c954965f776f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.819388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:33.849157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd35dc3-6d88-4b91-8784-9558e22bae80 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.874814 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90c7b0-bd57-452b-8b8e-c954965f776f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:33.885303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478b359-c97c-401f-9e6f-b4ecf1e1dd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.886101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478b359-c97c-401f-9e6f-b4ecf1e1dd9f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.886373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478b359-c97c-401f-9e6f-b4ecf1e1dd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.886652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478b359-c97c-401f-9e6f-b4ecf1e1dd9f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.892691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:33.894249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478b359-c97c-401f-9e6f-b4ecf1e1dd9f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.895739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478b359-c97c-401f-9e6f-b4ecf1e1dd9f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b478b359-c97c-401f-9e6f-b4ecf1e1dd9f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:33.910419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:33.911904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:33.912870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 298/589] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:33.913479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aa4b4-5494-4596-998a-353f43f9c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:33.913479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa4b4-5494-4596-998a-353f43f9c823 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.913969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6a14f-6cd2-4590-9e8a-37752f0cfc45 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:33.914040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa4b4-5494-4596-998a-353f43f9c823 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.914108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6a14f-6cd2-4590-9e8a-37752f0cfc45 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:33.914174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa4b4-5494-4596-998a-353f43f9c823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.914250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6a14f-6cd2-4590-9e8a-37752f0cfc45 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:33.915010 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 299/590] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:33.915690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6a14f-6cd2-4590-9e8a-37752f0cfc45 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:33.928172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aa4b4-5494-4596-998a-353f43f9c823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:33.929684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aa4b4-5494-4596-998a-353f43f9c823 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-6c9aa4b4-5494-4596-998a-353f43f9c823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:33.947499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:33.948417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:33.949535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:33.949535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:33.949535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:33.949535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:33.949535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 292/591] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:33.949535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aa4b4-5494-4596-998a-353f43f9c823 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.020454 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6a14f-6cd2-4590-9e8a-37752f0cfc45 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.045577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aa4b4-5494-4596-998a-353f43f9c823 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.050575 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:34.056066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738a1a-549e-4fb0-a2dc-c73e3c8bdea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.056774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738a1a-549e-4fb0-a2dc-c73e3c8bdea9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.057061 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738a1a-549e-4fb0-a2dc-c73e3c8bdea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.057337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738a1a-549e-4fb0-a2dc-c73e3c8bdea9 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.058135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f738a1a-549e-4fb0-a2dc-c73e3c8bdea9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:34.058442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f738a1a-549e-4fb0-a2dc-c73e3c8bdea9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:34.059897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f738a1a-549e-4fb0-a2dc-c73e3c8bdea9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:34.072016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 300/592] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:34.072872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738a1a-549e-4fb0-a2dc-c73e3c8bdea9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.079946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a550d56-f76e-4847-941f-202c662cef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.080773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a550d56-f76e-4847-941f-202c662cef49 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.081057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a550d56-f76e-4847-941f-202c662cef49 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.081331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a550d56-f76e-4847-941f-202c662cef49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.092060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a550d56-f76e-4847-941f-202c662cef49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:34.093550 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a550d56-f76e-4847-941f-202c662cef49 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-1a550d56-f76e-4847-941f-202c662cef49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:34.112018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:34.112960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:34.113841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:34.113841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:34.113841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:34.113841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:34.113841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 293/593] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:34.114776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51f65-c3d2-49b8-9b43-34c1409b06a6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.115233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51f65-c3d2-49b8-9b43-34c1409b06a6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.115514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51f65-c3d2-49b8-9b43-34c1409b06a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.131857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-15f51f65-c3d2-49b8-9b43-34c1409b06a6 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:34.133116 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-15f51f65-c3d2-49b8-9b43-34c1409b06a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:34.147576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:34.178263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738a1a-549e-4fb0-a2dc-c73e3c8bdea9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.199542 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 294/594] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:34.200445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51f65-c3d2-49b8-9b43-34c1409b06a6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.220226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23858b5b-8596-4f93-9bf4-de41a0d225c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.221228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23858b5b-8596-4f93-9bf4-de41a0d225c2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.221512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23858b5b-8596-4f93-9bf4-de41a0d225c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.221791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23858b5b-8596-4f93-9bf4-de41a0d225c2 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.222667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23858b5b-8596-4f93-9bf4-de41a0d225c2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:34.222977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23858b5b-8596-4f93-9bf4-de41a0d225c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:34.224482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23858b5b-8596-4f93-9bf4-de41a0d225c2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:34.241667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 301/595] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Jul 14 09:05:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:34.242444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23858b5b-8596-4f93-9bf4-de41a0d225c2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.290562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:34.299243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51f65-c3d2-49b8-9b43-34c1409b06a6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.334205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203730a-87f2-4637-93a2-40c0c4046121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.334870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203730a-87f2-4637-93a2-40c0c4046121 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.335152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203730a-87f2-4637-93a2-40c0c4046121 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.335427 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203730a-87f2-4637-93a2-40c0c4046121 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.336164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203730a-87f2-4637-93a2-40c0c4046121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:34.336465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203730a-87f2-4637-93a2-40c0c4046121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:34.337881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203730a-87f2-4637-93a2-40c0c4046121 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:34.347122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23858b5b-8596-4f93-9bf4-de41a0d225c2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.353257 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 295/596] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:34.354453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203730a-87f2-4637-93a2-40c0c4046121 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.371969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:34.386459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be35819-98e1-4846-9a66-6e1291a6a1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.387446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be35819-98e1-4846-9a66-6e1291a6a1c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.387788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be35819-98e1-4846-9a66-6e1291a6a1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.388060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be35819-98e1-4846-9a66-6e1291a6a1c0 None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/ebf4ab9d717e4c838d68590336074f09/roles/14d87e5720e84adba77d427eed713973` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.403099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be35819-98e1-4846-9a66-6e1291a6a1c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=ebf4ab9d717e4c838d68590336074f09, role_id=14d87e5720e84adba77d427eed713973)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:34.404537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be35819-98e1-4846-9a66-6e1291a6a1c0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:34.419864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 302/597] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:05:34 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/ebf4ab9d717e4c838d68590336074f09/roles/14d87e5720e84adba77d427eed713973 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:34.421143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be35819-98e1-4846-9a66-6e1291a6a1c0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.490598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203730a-87f2-4637-93a2-40c0c4046121 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.529026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999315c-7cdc-49e9-901f-8d0ec9fd18c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.529869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999315c-7cdc-49e9-901f-8d0ec9fd18c0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.530255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999315c-7cdc-49e9-901f-8d0ec9fd18c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.530633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999315c-7cdc-49e9-901f-8d0ec9fd18c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.531461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999315c-7cdc-49e9-901f-8d0ec9fd18c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:34.531867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999315c-7cdc-49e9-901f-8d0ec9fd18c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:34.533358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999315c-7cdc-49e9-901f-8d0ec9fd18c0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:34.535376 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:34.539428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be35819-98e1-4846-9a66-6e1291a6a1c0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.552127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 296/598] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:34.552127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999315c-7cdc-49e9-901f-8d0ec9fd18c0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.587818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2504a9-046d-4b83-b81c-7759fa034ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.588622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2504a9-046d-4b83-b81c-7759fa034ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.588926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2504a9-046d-4b83-b81c-7759fa034ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.589198 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2504a9-046d-4b83-b81c-7759fa034ba5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.599953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2504a9-046d-4b83-b81c-7759fa034ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-4a2504a9-046d-4b83-b81c-7759fa034ba5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:34.607765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:34.608894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 303/599] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:34.613925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2504a9-046d-4b83-b81c-7759fa034ba5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.638844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:34.673355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999315c-7cdc-49e9-901f-8d0ec9fd18c0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.710316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9329f0-47ee-4c05-99eb-aed1f0646006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.711119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9329f0-47ee-4c05-99eb-aed1f0646006 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.711400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9329f0-47ee-4c05-99eb-aed1f0646006 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.711674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9329f0-47ee-4c05-99eb-aed1f0646006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.715357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2504a9-046d-4b83-b81c-7759fa034ba5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.723451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9329f0-47ee-4c05-99eb-aed1f0646006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:34.725642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9329f0-47ee-4c05-99eb-aed1f0646006 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-bf9329f0-47ee-4c05-99eb-aed1f0646006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:34.746762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:34.747914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:34.749009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:34.749009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:34.749009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:34.749009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:34.749009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 297/600] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:34.749305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9329f0-47ee-4c05-99eb-aed1f0646006 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.757702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780f64d-30cb-4210-8641-51748a0072ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.758943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780f64d-30cb-4210-8641-51748a0072ec None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.759228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780f64d-30cb-4210-8641-51748a0072ec None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.759548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780f64d-30cb-4210-8641-51748a0072ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.769173 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780f64d-30cb-4210-8641-51748a0072ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:34.770646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780f64d-30cb-4210-8641-51748a0072ec None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-6780f64d-30cb-4210-8641-51748a0072ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:34.784967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:34.786304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:34.792085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:34.792085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:34.792085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:34.792085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:34.792085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:34.792085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:34.792085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:34.792085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:34.792085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 304/601] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:34.792085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780f64d-30cb-4210-8641-51748a0072ec None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.812165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:34.862975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9329f0-47ee-4c05-99eb-aed1f0646006 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.887010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:34.899030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780f64d-30cb-4210-8641-51748a0072ec None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:34.900387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e65e8-ac42-4929-b3d8-b8a01398671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.901230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e65e8-ac42-4929-b3d8-b8a01398671e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.901510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e65e8-ac42-4929-b3d8-b8a01398671e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.901777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e65e8-ac42-4929-b3d8-b8a01398671e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.909084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e65e8-ac42-4929-b3d8-b8a01398671e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:34.911422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e65e8-ac42-4929-b3d8-b8a01398671e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-948e65e8-ac42-4929-b3d8-b8a01398671e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:34.929404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:34.930930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:34.932104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:34.932104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:34.932104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:34.932104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:34.932104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:34.932104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:34.932104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:34.932104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:34.935419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 298/602] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:34.936247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e65e8-ac42-4929-b3d8-b8a01398671e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:34.938448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfcaf4-585b-49ee-ac91-42e69dd203f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:34.939124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfcaf4-585b-49ee-ac91-42e69dd203f6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:34.939407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfcaf4-585b-49ee-ac91-42e69dd203f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:34.939700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfcaf4-585b-49ee-ac91-42e69dd203f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:34.940435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfcaf4-585b-49ee-ac91-42e69dd203f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:34.940767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfcaf4-585b-49ee-ac91-42e69dd203f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:34.942126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfcaf4-585b-49ee-ac91-42e69dd203f6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:34.954948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 305/603] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:34.954948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfcaf4-585b-49ee-ac91-42e69dd203f6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:35.038873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:35.050821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e65e8-ac42-4929-b3d8-b8a01398671e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:35.058982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfcaf4-585b-49ee-ac91-42e69dd203f6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:35.086199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276ccd7-82f7-40a3-8764-eb765f14a375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:35.086867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276ccd7-82f7-40a3-8764-eb765f14a375 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:35.087259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276ccd7-82f7-40a3-8764-eb765f14a375 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:35.087535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276ccd7-82f7-40a3-8764-eb765f14a375 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:35.088254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276ccd7-82f7-40a3-8764-eb765f14a375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:35.088556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276ccd7-82f7-40a3-8764-eb765f14a375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:35.089961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276ccd7-82f7-40a3-8764-eb765f14a375 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:35.095545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8c4c-34c1-4527-b82d-ad91d6f7ab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:35.096209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8c4c-34c1-4527-b82d-ad91d6f7ab9f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:35.096490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8c4c-34c1-4527-b82d-ad91d6f7ab9f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:35.096791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8c4c-34c1-4527-b82d-ad91d6f7ab9f None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:35.097580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b8c4c-34c1-4527-b82d-ad91d6f7ab9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:35.097886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b8c4c-34c1-4527-b82d-ad91d6f7ab9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:35.099590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b8c4c-34c1-4527-b82d-ad91d6f7ab9f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:35.102522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 299/604] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:35.105623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276ccd7-82f7-40a3-8764-eb765f14a375 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:35.113632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 306/605] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:35.114640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8c4c-34c1-4527-b82d-ad91d6f7ab9f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:35.152178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:35.214872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276ccd7-82f7-40a3-8764-eb765f14a375 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:35.221039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8c4c-34c1-4527-b82d-ad91d6f7ab9f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:35.252213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0255627-bbbe-46bc-b5d7-f928149caad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:35.253191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255627-bbbe-46bc-b5d7-f928149caad3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:35.253662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255627-bbbe-46bc-b5d7-f928149caad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:35.254109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0255627-bbbe-46bc-b5d7-f928149caad3 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:35.254223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9386a5b-3f88-41f8-a5f2-a66ae5a67e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:35.254953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9386a5b-3f88-41f8-a5f2-a66ae5a67e8f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:35.255236 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9386a5b-3f88-41f8-a5f2-a66ae5a67e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:35.255561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0255627-bbbe-46bc-b5d7-f928149caad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:35.255662 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9386a5b-3f88-41f8-a5f2-a66ae5a67e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:35.256133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0255627-bbbe-46bc-b5d7-f928149caad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:35.257888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0255627-bbbe-46bc-b5d7-f928149caad3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:35.265942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9386a5b-3f88-41f8-a5f2-a66ae5a67e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:35.267367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9386a5b-3f88-41f8-a5f2-a66ae5a67e8f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:35.269235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:35.271854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 300/606] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:35.272888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0255627-bbbe-46bc-b5d7-f928149caad3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-a9386a5b-3f88-41f8-a5f2-a66ae5a67e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:35.286527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:35.287541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:35.288448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:35.288448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:35.288448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:35.288448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:35.288448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 307/607] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:35.288448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9386a5b-3f88-41f8-a5f2-a66ae5a67e8f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:35.390675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0255627-bbbe-46bc-b5d7-f928149caad3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:35.392434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:35.400702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9386a5b-3f88-41f8-a5f2-a66ae5a67e8f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:35.429188 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff71c1-db2b-435c-9466-590a10f09d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:35.429920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff71c1-db2b-435c-9466-590a10f09d7e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:35.430200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff71c1-db2b-435c-9466-590a10f09d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:35.430480 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff71c1-db2b-435c-9466-590a10f09d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:35.438024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba22ad3-92bc-405f-b7e6-2a25682a2ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:35.438266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff71c1-db2b-435c-9466-590a10f09d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:35.438939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba22ad3-92bc-405f-b7e6-2a25682a2ecd None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:35.439220 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba22ad3-92bc-405f-b7e6-2a25682a2ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:35.439479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff71c1-db2b-435c-9466-590a10f09d7e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:35.439573 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba22ad3-92bc-405f-b7e6-2a25682a2ecd None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/66f1d95bcc534f4e945fc2c5be046a5f/roles/14d87e5720e84adba77d427eed713973` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-25ff71c1-db2b-435c-9466-590a10f09d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:35.455007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:35.455951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:35.461944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:35.461944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:35.461944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:35.461944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:35.461944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:35.461944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:35.461944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:35.461944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:35.462377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba22ad3-92bc-405f-b7e6-2a25682a2ecd None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=66f1d95bcc534f4e945fc2c5be046a5f, role_id=14d87e5720e84adba77d427eed713973)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:35.462377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba22ad3-92bc-405f-b7e6-2a25682a2ecd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:35.462505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 301/608] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:35.462505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff71c1-db2b-435c-9466-590a10f09d7e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:35.474191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 308/609] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:05:35 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/66f1d95bcc534f4e945fc2c5be046a5f/roles/14d87e5720e84adba77d427eed713973 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:35.475305 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba22ad3-92bc-405f-b7e6-2a25682a2ecd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:35.543560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:35.595114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff71c1-db2b-435c-9466-590a10f09d7e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:35.622356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba22ad3-92bc-405f-b7e6-2a25682a2ecd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:35.634636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1a227-c5be-4b26-8b07-235401c6bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:35.635549 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a227-c5be-4b26-8b07-235401c6bb64 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:35.635825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a227-c5be-4b26-8b07-235401c6bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:35.636095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a227-c5be-4b26-8b07-235401c6bb64 None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/4f9b12f6e7e347e19e5183d7e45b162f/roles/14d87e5720e84adba77d427eed713973` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:35.653642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1a227-c5be-4b26-8b07-235401c6bb64 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=4f9b12f6e7e347e19e5183d7e45b162f, role_id=14d87e5720e84adba77d427eed713973)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:35.655101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1a227-c5be-4b26-8b07-235401c6bb64 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:35.671757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 302/610] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:05:35 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/4f9b12f6e7e347e19e5183d7e45b162f/roles/14d87e5720e84adba77d427eed713973 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:35.672685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1a227-c5be-4b26-8b07-235401c6bb64 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:35.681707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f5b6f-5113-4e64-88a4-78b3b729997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:35.682741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f5b6f-5113-4e64-88a4-78b3b729997d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:35.682741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f5b6f-5113-4e64-88a4-78b3b729997d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:35.682989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f5b6f-5113-4e64-88a4-78b3b729997d None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:35.683730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f5b6f-5113-4e64-88a4-78b3b729997d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:35.684032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f5b6f-5113-4e64-88a4-78b3b729997d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:35.685477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f5b6f-5113-4e64-88a4-78b3b729997d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:35.690787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:35.708574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 309/611] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:35.715396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f5b6f-5113-4e64-88a4-78b3b729997d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:35.846420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f5b6f-5113-4e64-88a4-78b3b729997d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:35.849580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:35.852732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1a227-c5be-4b26-8b07-235401c6bb64 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:35.891692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dcb8a-e7e5-4a02-85c8-8bd2b1ac9f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:35.892920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dcb8a-e7e5-4a02-85c8-8bd2b1ac9f67 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:35.893028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee926-c482-4762-8983-13e62f3f767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:35.893512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dcb8a-e7e5-4a02-85c8-8bd2b1ac9f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:35.893617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee926-c482-4762-8983-13e62f3f767c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:35.893866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee926-c482-4762-8983-13e62f3f767c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:35.894143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee926-c482-4762-8983-13e62f3f767c None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:35.894484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dcb8a-e7e5-4a02-85c8-8bd2b1ac9f67 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:35.895002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee926-c482-4762-8983-13e62f3f767c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:35.895692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee926-c482-4762-8983-13e62f3f767c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:35.897279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee926-c482-4762-8983-13e62f3f767c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:35.904995 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05dcb8a-e7e5-4a02-85c8-8bd2b1ac9f67 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:35.907238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05dcb8a-e7e5-4a02-85c8-8bd2b1ac9f67 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:35.910083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 303/612] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:35.917629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee926-c482-4762-8983-13e62f3f767c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d05dcb8a-e7e5-4a02-85c8-8bd2b1ac9f67 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:35.925794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:35.926867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:35.927948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:35.927948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:35.927948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:35.927948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:35.927948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:35.927948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:35.927948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:35.927948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:35.927948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:05:35.927948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:35.935375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 310/613] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:35.937456 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dcb8a-e7e5-4a02-85c8-8bd2b1ac9f67 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:36.039667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:36.062664 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dcb8a-e7e5-4a02-85c8-8bd2b1ac9f67 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:36.097252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5a142-aa3b-485d-8563-7b137444f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:36.098403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5a142-aa3b-485d-8563-7b137444f380 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:36.098691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5a142-aa3b-485d-8563-7b137444f380 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:36.098969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5a142-aa3b-485d-8563-7b137444f380 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:36.099819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5a142-aa3b-485d-8563-7b137444f380 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:36.100125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5a142-aa3b-485d-8563-7b137444f380 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:36.101580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5a142-aa3b-485d-8563-7b137444f380 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:36.122435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 311/614] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jul 14 09:05:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:36.128292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5a142-aa3b-485d-8563-7b137444f380 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:36.146919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee926-c482-4762-8983-13e62f3f767c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:36.157231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:36.237895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763979f6-6aab-4310-992f-2c38ea51d411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:36.239300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763979f6-6aab-4310-992f-2c38ea51d411 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:36.239865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763979f6-6aab-4310-992f-2c38ea51d411 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:36.240337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763979f6-6aab-4310-992f-2c38ea51d411 None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/60db5d8bc4cb4ce7af8bfac2c4eb2390/roles/14d87e5720e84adba77d427eed713973` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:36.243960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5a142-aa3b-485d-8563-7b137444f380 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:36.277914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763979f6-6aab-4310-992f-2c38ea51d411 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=60db5d8bc4cb4ce7af8bfac2c4eb2390, role_id=14d87e5720e84adba77d427eed713973)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:36.280196 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763979f6-6aab-4310-992f-2c38ea51d411 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:36.287565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff39e83-81eb-4d61-97fc-b009d6a202f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:36.288469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39e83-81eb-4d61-97fc-b009d6a202f5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:36.289380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39e83-81eb-4d61-97fc-b009d6a202f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:36.289380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39e83-81eb-4d61-97fc-b009d6a202f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:36.304560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 304/615] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:05:35 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/60db5d8bc4cb4ce7af8bfac2c4eb2390/roles/14d87e5720e84adba77d427eed713973 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:36.315440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff39e83-81eb-4d61-97fc-b009d6a202f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:36.316941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff39e83-81eb-4d61-97fc-b009d6a202f5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-eff39e83-81eb-4d61-97fc-b009d6a202f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:36.337909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:36.338883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:36.340259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:36.340259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:36.340259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:36.340259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:36.340259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 312/616] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:36.346854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763979f6-6aab-4310-992f-2c38ea51d411 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:36.465526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763979f6-6aab-4310-992f-2c38ea51d411 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:36.490671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:36.502494 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43c75b-c58c-4185-a0ea-e037bee6defb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:36.503215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43c75b-c58c-4185-a0ea-e037bee6defb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:36.503548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43c75b-c58c-4185-a0ea-e037bee6defb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:36.503821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43c75b-c58c-4185-a0ea-e037bee6defb None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:36.504650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43c75b-c58c-4185-a0ea-e037bee6defb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:36.504993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43c75b-c58c-4185-a0ea-e037bee6defb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:36.506648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43c75b-c58c-4185-a0ea-e037bee6defb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:36.520304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 305/617] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:36.529860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff39e83-81eb-4d61-97fc-b009d6a202f5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:36.597602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0e10-69ee-43d0-befd-f37f8ae88793 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:36.598081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0e10-69ee-43d0-befd-f37f8ae88793 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:36.598582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0e10-69ee-43d0-befd-f37f8ae88793 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:36.600312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 306/618] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:36.606120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de500f3-25ca-4d28-994a-92dd95a8d223 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:36.606534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de500f3-25ca-4d28-994a-92dd95a8d223 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:36.606934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de500f3-25ca-4d28-994a-92dd95a8d223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:36.623741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:36.628080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0de500f3-25ca-4d28-994a-92dd95a8d223 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:36.629584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0de500f3-25ca-4d28-994a-92dd95a8d223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:36.650760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff39e83-81eb-4d61-97fc-b009d6a202f5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:36.687724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0defaa2-a349-44f5-9847-1af79d0a44e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:36.688631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0defaa2-a349-44f5-9847-1af79d0a44e4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:36.689011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0defaa2-a349-44f5-9847-1af79d0a44e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:36.689358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0defaa2-a349-44f5-9847-1af79d0a44e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:36.697338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0defaa2-a349-44f5-9847-1af79d0a44e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:36.699068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0defaa2-a349-44f5-9847-1af79d0a44e4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:36.704188 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 307/619] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-e0defaa2-a349-44f5-9847-1af79d0a44e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:36.714040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:36.715286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:36.716387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:36.716387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:36.716387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:36.716387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:36.716387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:36.716387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:36.716387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:36.716387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:36.717028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 313/620] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:36.722788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de500f3-25ca-4d28-994a-92dd95a8d223 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:36.735888 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0defaa2-a349-44f5-9847-1af79d0a44e4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:36.893073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de500f3-25ca-4d28-994a-92dd95a8d223 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:36.902482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:36.917792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0defaa2-a349-44f5-9847-1af79d0a44e4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:36.947937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4c5f7-24b9-4d9d-b1f6-de865df24696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:36.949006 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4c5f7-24b9-4d9d-b1f6-de865df24696 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:36.950417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4c5f7-24b9-4d9d-b1f6-de865df24696 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:36.950891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4c5f7-24b9-4d9d-b1f6-de865df24696 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:36.955033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4c5f7-24b9-4d9d-b1f6-de865df24696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:36.955589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4c5f7-24b9-4d9d-b1f6-de865df24696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:36.957289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4c5f7-24b9-4d9d-b1f6-de865df24696 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:36.977084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 308/621] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:36.979640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4c5f7-24b9-4d9d-b1f6-de865df24696 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:36.988268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857fe6-c706-4b5f-8acd-7c8db5abb067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:36.989825 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857fe6-c706-4b5f-8acd-7c8db5abb067 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:36.990317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857fe6-c706-4b5f-8acd-7c8db5abb067 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:36.990783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857fe6-c706-4b5f-8acd-7c8db5abb067 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:36.997459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:37.018433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50857fe6-c706-4b5f-8acd-7c8db5abb067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-50857fe6-c706-4b5f-8acd-7c8db5abb067 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:37.029826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:37.030843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:37.031711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:37.038234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 314/622] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:37.038234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857fe6-c706-4b5f-8acd-7c8db5abb067 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:37.185243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4c5f7-24b9-4d9d-b1f6-de865df24696 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:37.197741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857fe6-c706-4b5f-8acd-7c8db5abb067 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:37.228001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01af2d3-1760-44f8-88b1-8d6bba77f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:37.229251 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af2d3-1760-44f8-88b1-8d6bba77f5ce None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:37.229738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af2d3-1760-44f8-88b1-8d6bba77f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:37.230307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af2d3-1760-44f8-88b1-8d6bba77f5ce None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/2dab40ef1f8d4f5abf10b92e99e04122/roles/14d87e5720e84adba77d427eed713973` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:37.241809 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c01fb-95f2-4bc6-8c0b-ca60f077314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:37.242558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c01fb-95f2-4bc6-8c0b-ca60f077314f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:37.242853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c01fb-95f2-4bc6-8c0b-ca60f077314f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:37.243158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c01fb-95f2-4bc6-8c0b-ca60f077314f None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:37.243910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c01fb-95f2-4bc6-8c0b-ca60f077314f None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:37.244295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c01fb-95f2-4bc6-8c0b-ca60f077314f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:37.245859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c01fb-95f2-4bc6-8c0b-ca60f077314f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:37.247717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01af2d3-1760-44f8-88b1-8d6bba77f5ce None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=2dab40ef1f8d4f5abf10b92e99e04122, role_id=14d87e5720e84adba77d427eed713973)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:37.249394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01af2d3-1760-44f8-88b1-8d6bba77f5ce None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:37.257880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 315/623] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:37.265493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c01fb-95f2-4bc6-8c0b-ca60f077314f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:37.272843 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 309/624] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:05:36 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/2dab40ef1f8d4f5abf10b92e99e04122/roles/14d87e5720e84adba77d427eed713973 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:37.333747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:37.403971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c01fb-95f2-4bc6-8c0b-ca60f077314f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:37.461448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5783b-03b4-43ac-a30f-6cca130406be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:37.463124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5783b-03b4-43ac-a30f-6cca130406be None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:37.463814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5783b-03b4-43ac-a30f-6cca130406be None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:37.464496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5783b-03b4-43ac-a30f-6cca130406be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:37.485007 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5783b-03b4-43ac-a30f-6cca130406be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:37.487341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5783b-03b4-43ac-a30f-6cca130406be None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-3ed5783b-03b4-43ac-a30f-6cca130406be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:37.511142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:37.512140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:37.513098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:37.513098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:37.513098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:37.513098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:37.515572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 316/625] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:37.522266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01af2d3-1760-44f8-88b1-8d6bba77f5ce None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:37.564079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:37.652207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01af2d3-1760-44f8-88b1-8d6bba77f5ce None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:37.698370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2491c-3939-41c8-977a-d75e77cbaf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:37.699051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2491c-3939-41c8-977a-d75e77cbaf65 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:37.699339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2491c-3939-41c8-977a-d75e77cbaf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:37.699614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2491c-3939-41c8-977a-d75e77cbaf65 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:37.700352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2491c-3939-41c8-977a-d75e77cbaf65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:37.700676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2491c-3939-41c8-977a-d75e77cbaf65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:37.702053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2491c-3939-41c8-977a-d75e77cbaf65 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:37.719911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 310/626] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:37.725551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5783b-03b4-43ac-a30f-6cca130406be None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:37.844161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5783b-03b4-43ac-a30f-6cca130406be None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:37.861093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:37.886388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c113e-e91f-4e20-b7fd-5f0f8acf6ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:37.887653 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c113e-e91f-4e20-b7fd-5f0f8acf6ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:37.888086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c113e-e91f-4e20-b7fd-5f0f8acf6ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:37.888508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c113e-e91f-4e20-b7fd-5f0f8acf6ed8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:37.901696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c113e-e91f-4e20-b7fd-5f0f8acf6ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:37.903616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c113e-e91f-4e20-b7fd-5f0f8acf6ed8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-521c113e-e91f-4e20-b7fd-5f0f8acf6ed8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:37.923050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:37.924100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:37.925457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 317/627] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:37.932681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2491c-3939-41c8-977a-d75e77cbaf65 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:38.047858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:38.072452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2491c-3939-41c8-977a-d75e77cbaf65 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:38.127751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a106c4-596c-4c11-8218-fdedd61d1615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:38.128523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a106c4-596c-4c11-8218-fdedd61d1615 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.128830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a106c4-596c-4c11-8218-fdedd61d1615 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.129155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a106c4-596c-4c11-8218-fdedd61d1615 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.130019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a106c4-596c-4c11-8218-fdedd61d1615 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:38.130327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a106c4-596c-4c11-8218-fdedd61d1615 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:38.131765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a106c4-596c-4c11-8218-fdedd61d1615 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:38.150176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ca92a-96a7-42fe-988f-032a11d15f24 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.150472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ca92a-96a7-42fe-988f-032a11d15f24 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.150742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ca92a-96a7-42fe-988f-032a11d15f24 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.152396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 318/628] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:38.157692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab96760-3e64-4ddf-8475-119ea4d215b7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.157982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab96760-3e64-4ddf-8475-119ea4d215b7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.158262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab96760-3e64-4ddf-8475-119ea4d215b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.159735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 311/629] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jul 14 09:05:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:38.165356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a106c4-596c-4c11-8218-fdedd61d1615 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:38.186157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cab96760-3e64-4ddf-8475-119ea4d215b7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:38.187353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cab96760-3e64-4ddf-8475-119ea4d215b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:38.272028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a106c4-596c-4c11-8218-fdedd61d1615 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:38.273112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 319/630] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:38.274501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605476d4-20b5-47d1-93d4-e974f42c02fa None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.275028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605476d4-20b5-47d1-93d4-e974f42c02fa None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.275315 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605476d4-20b5-47d1-93d4-e974f42c02fa None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.285196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 320/631] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:38.291323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a3cac-1740-4e55-9772-f68648a8a525 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.291611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a3cac-1740-4e55-9772-f68648a8a525 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.291880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a3cac-1740-4e55-9772-f68648a8a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.314416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-654a3cac-1740-4e55-9772-f68648a8a525 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:38.316131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-654a3cac-1740-4e55-9772-f68648a8a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:38.323502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129ab41-1799-4dd4-8c73-a9386efed951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:38.324163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129ab41-1799-4dd4-8c73-a9386efed951 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.324450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129ab41-1799-4dd4-8c73-a9386efed951 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.324759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129ab41-1799-4dd4-8c73-a9386efed951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.336930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:38.405324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 321/632] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:38.406489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a3cac-1740-4e55-9772-f68648a8a525 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:38.420520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129ab41-1799-4dd4-8c73-a9386efed951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:38.422013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129ab41-1799-4dd4-8c73-a9386efed951 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:38.437026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:38.533559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a3cac-1740-4e55-9772-f68648a8a525 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:38.558443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 312/633] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:05:38.559456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129ab41-1799-4dd4-8c73-a9386efed951 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:38.577430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d0632-9af1-4096-a3f9-c5cc570bf42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:38.578424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0632-9af1-4096-a3f9-c5cc570bf42e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.579170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0632-9af1-4096-a3f9-c5cc570bf42e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.579455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0632-9af1-4096-a3f9-c5cc570bf42e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.593430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d0632-9af1-4096-a3f9-c5cc570bf42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-1e9d0632-9af1-4096-a3f9-c5cc570bf42e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:38.602598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:38.603537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:38.604542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 322/634] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:38.606454 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d0632-9af1-4096-a3f9-c5cc570bf42e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:38.613373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:38.677530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129ab41-1799-4dd4-8c73-a9386efed951 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:38.698105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:38.712578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d0632-9af1-4096-a3f9-c5cc570bf42e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:38.714261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701476ed-dc61-45e7-99e7-f9a9ae872e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:38.715318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701476ed-dc61-45e7-99e7-f9a9ae872e6d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.715849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701476ed-dc61-45e7-99e7-f9a9ae872e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.716349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701476ed-dc61-45e7-99e7-f9a9ae872e6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.728113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701476ed-dc61-45e7-99e7-f9a9ae872e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-701476ed-dc61-45e7-99e7-f9a9ae872e6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:38.736482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:38.737461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:38.738380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:38.741172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 313/635] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:38.742422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701476ed-dc61-45e7-99e7-f9a9ae872e6d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:38.754081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad60c4-2d5a-4ed3-83dc-ab4142121dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:38.755122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad60c4-2d5a-4ed3-83dc-ab4142121dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.755404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad60c4-2d5a-4ed3-83dc-ab4142121dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.755680 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad60c4-2d5a-4ed3-83dc-ab4142121dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.768329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad60c4-2d5a-4ed3-83dc-ab4142121dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:38.769887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad60c4-2d5a-4ed3-83dc-ab4142121dc3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-f1ad60c4-2d5a-4ed3-83dc-ab4142121dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:38.788179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:38.789209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:38.790099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:38.790099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:38.790099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:38.790099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:38.790099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 323/636] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:38.790813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad60c4-2d5a-4ed3-83dc-ab4142121dc3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:38.853844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:38.857837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701476ed-dc61-45e7-99e7-f9a9ae872e6d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:38.895045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad60c4-2d5a-4ed3-83dc-ab4142121dc3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:38.895467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b0125-96b6-42ba-b9a4-6d3176c741ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:38.896363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b0125-96b6-42ba-b9a4-6d3176c741ae None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.896887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b0125-96b6-42ba-b9a4-6d3176c741ae None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.897405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b0125-96b6-42ba-b9a4-6d3176c741ae None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.898381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b0125-96b6-42ba-b9a4-6d3176c741ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:38.898890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b0125-96b6-42ba-b9a4-6d3176c741ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:38.900462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b0125-96b6-42ba-b9a4-6d3176c741ae None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:38.910181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 314/637] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:38.911369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b0125-96b6-42ba-b9a4-6d3176c741ae None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:38.930171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145618d3-9654-4e79-8d43-368c0e101bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:38.930844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145618d3-9654-4e79-8d43-368c0e101bfc None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:38.931122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145618d3-9654-4e79-8d43-368c0e101bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:38.931389 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145618d3-9654-4e79-8d43-368c0e101bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:38.932134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145618d3-9654-4e79-8d43-368c0e101bfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:38.932433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145618d3-9654-4e79-8d43-368c0e101bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:38.933932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145618d3-9654-4e79-8d43-368c0e101bfc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:38.946996 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 324/638] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:38.948093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145618d3-9654-4e79-8d43-368c0e101bfc None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:38.950559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:39.019236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b0125-96b6-42ba-b9a4-6d3176c741ae None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.054382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ceb017-ee2a-456f-95aa-13b3f5cac55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.055047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceb017-ee2a-456f-95aa-13b3f5cac55b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.055331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceb017-ee2a-456f-95aa-13b3f5cac55b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.055609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceb017-ee2a-456f-95aa-13b3f5cac55b None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.056032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145618d3-9654-4e79-8d43-368c0e101bfc None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.056329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ceb017-ee2a-456f-95aa-13b3f5cac55b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:39.056633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ceb017-ee2a-456f-95aa-13b3f5cac55b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:39.058041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ceb017-ee2a-456f-95aa-13b3f5cac55b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:39.072411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 315/639] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:39.073317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ceb017-ee2a-456f-95aa-13b3f5cac55b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.095138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70404a4c-d4b6-4b13-8ba5-63a6f685d294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.096262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70404a4c-d4b6-4b13-8ba5-63a6f685d294 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.096779 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70404a4c-d4b6-4b13-8ba5-63a6f685d294 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.097369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70404a4c-d4b6-4b13-8ba5-63a6f685d294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.100291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:39.109020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70404a4c-d4b6-4b13-8ba5-63a6f685d294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:39.110726 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70404a4c-d4b6-4b13-8ba5-63a6f685d294 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-70404a4c-d4b6-4b13-8ba5-63a6f685d294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:39.130338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:39.131310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:39.132195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:39.132195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:39.132195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:39.132195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:39.132195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 325/640] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:39.132807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e43a4-47a9-464c-b70c-ed542ff9e2b6 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.133094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e43a4-47a9-464c-b70c-ed542ff9e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.133370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e43a4-47a9-464c-b70c-ed542ff9e2b6 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.138411 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 326/641] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:39.138411 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e43a4-47a9-464c-b70c-ed542ff9e2b6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.189267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ceb017-ee2a-456f-95aa-13b3f5cac55b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.197769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:39.225755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4200366-1404-4874-af19-8e88235b14e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.226560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200366-1404-4874-af19-8e88235b14e9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.226843 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200366-1404-4874-af19-8e88235b14e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.227119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200366-1404-4874-af19-8e88235b14e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.237364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4200366-1404-4874-af19-8e88235b14e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:39.238862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4200366-1404-4874-af19-8e88235b14e9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:39.245609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e43a4-47a9-464c-b70c-ed542ff9e2b6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-c4200366-1404-4874-af19-8e88235b14e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:39.256708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:39.257857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:39.258787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:39.258787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:39.258787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:39.258787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:39.258787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 316/642] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:39.258787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4200366-1404-4874-af19-8e88235b14e9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.283138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3cdf8-f002-4c99-a8a9-e7410aa660c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.284852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3cdf8-f002-4c99-a8a9-e7410aa660c0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.285335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3cdf8-f002-4c99-a8a9-e7410aa660c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.286214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3cdf8-f002-4c99-a8a9-e7410aa660c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.295906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3cdf8-f002-4c99-a8a9-e7410aa660c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:39.297789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3cdf8-f002-4c99-a8a9-e7410aa660c0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-46a3cdf8-f002-4c99-a8a9-e7410aa660c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:39.316782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:39.317941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:39.319155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:39.319155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:39.319155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:39.319155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:39.319155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:39.319155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:39.319155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:39.319155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:39.321504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 327/643] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:39.323504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a00763-0f87-4a3c-9227-cd7867c9fd3b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.323943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a00763-0f87-4a3c-9227-cd7867c9fd3b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.324490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a00763-0f87-4a3c-9227-cd7867c9fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.340514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:39.346174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-11a00763-0f87-4a3c-9227-cd7867c9fd3b None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:39.347965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-11a00763-0f87-4a3c-9227-cd7867c9fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:39.367352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4200366-1404-4874-af19-8e88235b14e9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.403550 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd0383-d631-4ca4-a646-9e727b951680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.404270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd0383-d631-4ca4-a646-9e727b951680 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.404560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd0383-d631-4ca4-a646-9e727b951680 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.404862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd0383-d631-4ca4-a646-9e727b951680 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.405595 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd0383-d631-4ca4-a646-9e727b951680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:39.405902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd0383-d631-4ca4-a646-9e727b951680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:39.407315 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd0383-d631-4ca4-a646-9e727b951680 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:39.424388 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 317/644] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:39.424388 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd0383-d631-4ca4-a646-9e727b951680 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.432714 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 328/645] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:39.432714 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a00763-0f87-4a3c-9227-cd7867c9fd3b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.477834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:39.534907 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a00763-0f87-4a3c-9227-cd7867c9fd3b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.546265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd0383-d631-4ca4-a646-9e727b951680 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.571173 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0f810-b60c-4787-a33a-14abeacfeb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.572126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0f810-b60c-4787-a33a-14abeacfeb6f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.572410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0f810-b60c-4787-a33a-14abeacfeb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.572708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0f810-b60c-4787-a33a-14abeacfeb6f None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.573511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0f810-b60c-4787-a33a-14abeacfeb6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:39.574061 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0f810-b60c-4787-a33a-14abeacfeb6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:39.575267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0f810-b60c-4787-a33a-14abeacfeb6f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:39.581485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81f93-e1e9-4887-a1d2-0a1c8b561bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.582209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81f93-e1e9-4887-a1d2-0a1c8b561bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.582493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81f93-e1e9-4887-a1d2-0a1c8b561bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.582770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81f93-e1e9-4887-a1d2-0a1c8b561bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.583502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d81f93-e1e9-4887-a1d2-0a1c8b561bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:39.583810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d81f93-e1e9-4887-a1d2-0a1c8b561bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:39.585205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d81f93-e1e9-4887-a1d2-0a1c8b561bc8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:39.586709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:39.592728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 329/646] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:39.592728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0f810-b60c-4787-a33a-14abeacfeb6f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.601770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 318/647] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:39.601770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81f93-e1e9-4887-a1d2-0a1c8b561bc8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.702270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0f810-b60c-4787-a33a-14abeacfeb6f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.703490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81f93-e1e9-4887-a1d2-0a1c8b561bc8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.704622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:39.740558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2312bca-f867-4d99-9122-7e44bafd70c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.741280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96052eb9-a3c9-4779-bf90-442a43a39534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.741421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312bca-f867-4d99-9122-7e44bafd70c3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.741702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312bca-f867-4d99-9122-7e44bafd70c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.742025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312bca-f867-4d99-9122-7e44bafd70c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.742184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96052eb9-a3c9-4779-bf90-442a43a39534 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.742435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96052eb9-a3c9-4779-bf90-442a43a39534 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.742707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96052eb9-a3c9-4779-bf90-442a43a39534 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.752538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2312bca-f867-4d99-9122-7e44bafd70c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:39.752709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96052eb9-a3c9-4779-bf90-442a43a39534 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:39.754782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96052eb9-a3c9-4779-bf90-442a43a39534 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d2312bca-f867-4d99-9122-7e44bafd70c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:39.760381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:39.761379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:39.762230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 319/648] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:39.762940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2312bca-f867-4d99-9122-7e44bafd70c3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-96052eb9-a3c9-4779-bf90-442a43a39534 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:39.769132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:39.770224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 330/649] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:39.771179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96052eb9-a3c9-4779-bf90-442a43a39534 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.820067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:39.871782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2312bca-f867-4d99-9122-7e44bafd70c3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.873100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96052eb9-a3c9-4779-bf90-442a43a39534 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:39.910834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f374f-77e1-4b1a-a9f9-d8ebf25bc2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.911166 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2269d-0de3-4441-8a98-02f83026c110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:39.911637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f374f-77e1-4b1a-a9f9-d8ebf25bc2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.911821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2269d-0de3-4441-8a98-02f83026c110 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.911921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f374f-77e1-4b1a-a9f9-d8ebf25bc2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.912105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2269d-0de3-4441-8a98-02f83026c110 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.912213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f374f-77e1-4b1a-a9f9-d8ebf25bc2d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.912377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2269d-0de3-4441-8a98-02f83026c110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.913245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2269d-0de3-4441-8a98-02f83026c110 None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=ebf4ab9d717e4c838d68590336074f09) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:39.913558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2269d-0de3-4441-8a98-02f83026c110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:39.915029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2269d-0de3-4441-8a98-02f83026c110 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:39.919632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f374f-77e1-4b1a-a9f9-d8ebf25bc2d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:39.921408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 320/650] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/role_assignments?user.id=ebf4ab9d717e4c838d68590336074f09&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:39.921544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f374f-77e1-4b1a-a9f9-d8ebf25bc2d1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:39.922279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cf102-267c-423e-be25-adca62ebeb53 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:39.922568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cf102-267c-423e-be25-adca62ebeb53 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:39.922846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cf102-267c-423e-be25-adca62ebeb53 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:39.924052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 321/651] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:39.924868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cf102-267c-423e-be25-adca62ebeb53 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-223f374f-77e1-4b1a-a9f9-d8ebf25bc2d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:39.950702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:39.951753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 331/652] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:39.954014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f374f-77e1-4b1a-a9f9-d8ebf25bc2d1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:39.992295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:40.050212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cf102-267c-423e-be25-adca62ebeb53 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:40.070660 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:40.089755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1db35-adef-4618-8b50-e4c943d04613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:40.089755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1db35-adef-4618-8b50-e4c943d04613 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:40.090060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1db35-adef-4618-8b50-e4c943d04613 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:40.090290 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f374f-77e1-4b1a-a9f9-d8ebf25bc2d1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:40.090418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1db35-adef-4618-8b50-e4c943d04613 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:40.091053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1db35-adef-4618-8b50-e4c943d04613 None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:40.091356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1db35-adef-4618-8b50-e4c943d04613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:40.092744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1db35-adef-4618-8b50-e4c943d04613 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:40.101426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 322/653] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:40.102680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f93ad-421b-46cd-a3aa-b40f7c34fd30 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:40.102998 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f93ad-421b-46cd-a3aa-b40f7c34fd30 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:40.103241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f93ad-421b-46cd-a3aa-b40f7c34fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:40.120220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-698f93ad-421b-46cd-a3aa-b40f7c34fd30 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:40.121486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-698f93ad-421b-46cd-a3aa-b40f7c34fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:40.132732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013cb65-8c51-4333-85bb-73cfac2a56bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:40.133419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013cb65-8c51-4333-85bb-73cfac2a56bc None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:40.133725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013cb65-8c51-4333-85bb-73cfac2a56bc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:40.134007 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013cb65-8c51-4333-85bb-73cfac2a56bc None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:40.134856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013cb65-8c51-4333-85bb-73cfac2a56bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:40.135167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013cb65-8c51-4333-85bb-73cfac2a56bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:40.136593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013cb65-8c51-4333-85bb-73cfac2a56bc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:40.156102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 332/654] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jul 14 09:05:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:40.157361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013cb65-8c51-4333-85bb-73cfac2a56bc None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:40.208760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 323/655] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:40.208760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f93ad-421b-46cd-a3aa-b40f7c34fd30 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:40.253971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:40.274633 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013cb65-8c51-4333-85bb-73cfac2a56bc None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:40.310172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b4b57-a28b-44ca-8b39-5904f51c13fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:40.310842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b4b57-a28b-44ca-8b39-5904f51c13fc None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:40.311133 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b4b57-a28b-44ca-8b39-5904f51c13fc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:40.311412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b4b57-a28b-44ca-8b39-5904f51c13fc None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:40.312259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b4b57-a28b-44ca-8b39-5904f51c13fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:40.312572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b4b57-a28b-44ca-8b39-5904f51c13fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:40.314074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b4b57-a28b-44ca-8b39-5904f51c13fc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:40.318309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f93ad-421b-46cd-a3aa-b40f7c34fd30 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:40.330944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:40.338114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 333/656] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jul 14 09:05:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:40.338114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b4b57-a28b-44ca-8b39-5904f51c13fc None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:40.355972 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa95a5-98b5-42c9-9f3f-cb27c5079a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:40.356935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa95a5-98b5-42c9-9f3f-cb27c5079a35 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:40.357249 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa95a5-98b5-42c9-9f3f-cb27c5079a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:40.357627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa95a5-98b5-42c9-9f3f-cb27c5079a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:40.371734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa95a5-98b5-42c9-9f3f-cb27c5079a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:40.375811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa95a5-98b5-42c9-9f3f-cb27c5079a35 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-cefa95a5-98b5-42c9-9f3f-cb27c5079a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:40.393039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:40.394076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:40.395387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:40.395387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:40.395387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:40.395387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:40.395387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 324/657] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:40.395703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa95a5-98b5-42c9-9f3f-cb27c5079a35 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:40.460735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b4b57-a28b-44ca-8b39-5904f51c13fc None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:40.498547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fcece-c52a-4f88-8da9-bcedc7b28552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:40.499679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fcece-c52a-4f88-8da9-bcedc7b28552 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:40.500218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fcece-c52a-4f88-8da9-bcedc7b28552 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:40.500571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fcece-c52a-4f88-8da9-bcedc7b28552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:40.502539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa95a5-98b5-42c9-9f3f-cb27c5079a35 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:40.512182 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:40.542239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330d611-5d2d-4676-b7af-b514bfb617cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:40.543046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330d611-5d2d-4676-b7af-b514bfb617cb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:40.543328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330d611-5d2d-4676-b7af-b514bfb617cb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:40.543598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330d611-5d2d-4676-b7af-b514bfb617cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:40.555063 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330d611-5d2d-4676-b7af-b514bfb617cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-9330d611-5d2d-4676-b7af-b514bfb617cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:40.562789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:40.563731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:40.564570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 325/658] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:40.565564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330d611-5d2d-4676-b7af-b514bfb617cb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:40.581890 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fcece-c52a-4f88-8da9-bcedc7b28552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:40.583512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fcece-c52a-4f88-8da9-bcedc7b28552 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:40.593728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:40.678021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330d611-5d2d-4676-b7af-b514bfb617cb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:40.687174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 334/659] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:40.688100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fcece-c52a-4f88-8da9-bcedc7b28552 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:40.718170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f5adf-b56c-4db3-a1e2-5e0fea8acc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:40.719091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f5adf-b56c-4db3-a1e2-5e0fea8acc37 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:40.719548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f5adf-b56c-4db3-a1e2-5e0fea8acc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:40.719825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f5adf-b56c-4db3-a1e2-5e0fea8acc37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:40.732694 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:40.794122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fcece-c52a-4f88-8da9-bcedc7b28552 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:40.794805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f5adf-b56c-4db3-a1e2-5e0fea8acc37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:40.796252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f5adf-b56c-4db3-a1e2-5e0fea8acc37 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:40.820135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:40.832892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e071d-5a15-4cbb-a5dc-0067d4b746ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:40.833568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e071d-5a15-4cbb-a5dc-0067d4b746ac None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:40.833851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e071d-5a15-4cbb-a5dc-0067d4b746ac None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:40.834129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e071d-5a15-4cbb-a5dc-0067d4b746ac None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:40.834858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e071d-5a15-4cbb-a5dc-0067d4b746ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:40.835165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e071d-5a15-4cbb-a5dc-0067d4b746ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:40.837032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e071d-5a15-4cbb-a5dc-0067d4b746ac None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:40.858891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 335/660] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:40.858891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e071d-5a15-4cbb-a5dc-0067d4b746ac None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:40.899914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 326/661] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:40.901160 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f5adf-b56c-4db3-a1e2-5e0fea8acc37 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:40.965439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:40.969762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e071d-5a15-4cbb-a5dc-0067d4b746ac None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.003531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f5adf-b56c-4db3-a1e2-5e0fea8acc37 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.010704 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184c2d6-0df4-4ebe-a281-a6e6468df36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.011796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184c2d6-0df4-4ebe-a281-a6e6468df36b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.012067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184c2d6-0df4-4ebe-a281-a6e6468df36b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.012344 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184c2d6-0df4-4ebe-a281-a6e6468df36b None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.013486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184c2d6-0df4-4ebe-a281-a6e6468df36b None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:41.013799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184c2d6-0df4-4ebe-a281-a6e6468df36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.015787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184c2d6-0df4-4ebe-a281-a6e6468df36b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.024756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 336/662] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:41.027934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184c2d6-0df4-4ebe-a281-a6e6468df36b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:41.031462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:41.044422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bb29c-5626-44a7-8cf6-7160fedc9dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.045222 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bb29c-5626-44a7-8cf6-7160fedc9dcc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.045581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bb29c-5626-44a7-8cf6-7160fedc9dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.045772 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bb29c-5626-44a7-8cf6-7160fedc9dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.056233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bb29c-5626-44a7-8cf6-7160fedc9dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.057875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bb29c-5626-44a7-8cf6-7160fedc9dcc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-200bb29c-5626-44a7-8cf6-7160fedc9dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:41.076377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:41.077357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:41.078266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:41.078266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:41.078266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:41.078266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:41.078266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 327/663] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:41.078561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bb29c-5626-44a7-8cf6-7160fedc9dcc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:41.140959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184c2d6-0df4-4ebe-a281-a6e6468df36b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.177992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca8f99-8cbf-4527-bfbe-1b93edd1bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.179086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca8f99-8cbf-4527-bfbe-1b93edd1bd0d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.179374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca8f99-8cbf-4527-bfbe-1b93edd1bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.179648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca8f99-8cbf-4527-bfbe-1b93edd1bd0d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.187568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca8f99-8cbf-4527-bfbe-1b93edd1bd0d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.189042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca8f99-8cbf-4527-bfbe-1b93edd1bd0d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.190408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bb29c-5626-44a7-8cf6-7160fedc9dcc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d3ca8f99-8cbf-4527-bfbe-1b93edd1bd0d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:41.203613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:41.204797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 337/664] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:41.209926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca8f99-8cbf-4527-bfbe-1b93edd1bd0d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:41.235049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f49c-92d3-4886-b276-893747b2f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.235783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f49c-92d3-4886-b276-893747b2f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.236067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f49c-92d3-4886-b276-893747b2f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.236342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f49c-92d3-4886-b276-893747b2f8a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.241529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:41.248202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957f49c-92d3-4886-b276-893747b2f8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.249678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957f49c-92d3-4886-b276-893747b2f8a5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-7957f49c-92d3-4886-b276-893747b2f8a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:41.267782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:41.268980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:41.274653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:41.274653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:41.274653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:41.274653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:41.274653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 328/665] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:41.274653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f49c-92d3-4886-b276-893747b2f8a5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:41.300369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:41.329241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca8f99-8cbf-4527-bfbe-1b93edd1bd0d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.366682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7dc11-5d30-4a29-ab73-19e4b4fdaf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.367493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7dc11-5d30-4a29-ab73-19e4b4fdaf72 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.367782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7dc11-5d30-4a29-ab73-19e4b4fdaf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.368077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7dc11-5d30-4a29-ab73-19e4b4fdaf72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.380056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7dc11-5d30-4a29-ab73-19e4b4fdaf72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.381549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7dc11-5d30-4a29-ab73-19e4b4fdaf72 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.384391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f49c-92d3-4886-b276-893747b2f8a5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2df7dc11-5d30-4a29-ab73-19e4b4fdaf72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:41.399294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:41.400202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:41.401167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:41.401167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:41.401167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:41.401167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:41.401167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 338/666] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:41.401450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7dc11-5d30-4a29-ab73-19e4b4fdaf72 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:41.421687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0e8c4-717f-4a37-9130-35238ca581be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.422438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0e8c4-717f-4a37-9130-35238ca581be None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.422722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0e8c4-717f-4a37-9130-35238ca581be None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.422990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0e8c4-717f-4a37-9130-35238ca581be None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.423710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0e8c4-717f-4a37-9130-35238ca581be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:41.424015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0e8c4-717f-4a37-9130-35238ca581be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.425594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0e8c4-717f-4a37-9130-35238ca581be None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.437559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 329/667] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:41.443338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0e8c4-717f-4a37-9130-35238ca581be None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:41.486357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:41.514249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7dc11-5d30-4a29-ab73-19e4b4fdaf72 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.532583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:41.548868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0e8c4-717f-4a37-9130-35238ca581be None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.552558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c2a50-c31f-4ac4-8384-9bd90abe2e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.553264 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c2a50-c31f-4ac4-8384-9bd90abe2e2d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.553545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c2a50-c31f-4ac4-8384-9bd90abe2e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.553815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c2a50-c31f-4ac4-8384-9bd90abe2e2d None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.554682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c2a50-c31f-4ac4-8384-9bd90abe2e2d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:41.554987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c2a50-c31f-4ac4-8384-9bd90abe2e2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.556412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c2a50-c31f-4ac4-8384-9bd90abe2e2d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.574453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 339/668] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:41.575253 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c2a50-c31f-4ac4-8384-9bd90abe2e2d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:41.592192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad49b4-0835-4feb-8e7e-7e6eee277f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.593224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad49b4-0835-4feb-8e7e-7e6eee277f6c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.593825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad49b4-0835-4feb-8e7e-7e6eee277f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.594301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad49b4-0835-4feb-8e7e-7e6eee277f6c None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.595314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad49b4-0835-4feb-8e7e-7e6eee277f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:41.595844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad49b4-0835-4feb-8e7e-7e6eee277f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.597632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad49b4-0835-4feb-8e7e-7e6eee277f6c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.610961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 330/669] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:41.616165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad49b4-0835-4feb-8e7e-7e6eee277f6c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:41.681239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c2a50-c31f-4ac4-8384-9bd90abe2e2d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.712035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:41.718015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a3c5a-b90f-4439-bead-1ebee6d459d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.718447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a3c5a-b90f-4439-bead-1ebee6d459d8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.718736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a3c5a-b90f-4439-bead-1ebee6d459d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.719016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a3c5a-b90f-4439-bead-1ebee6d459d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.719746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a3c5a-b90f-4439-bead-1ebee6d459d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:41.720055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a3c5a-b90f-4439-bead-1ebee6d459d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.721444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a3c5a-b90f-4439-bead-1ebee6d459d8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.727452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad49b4-0835-4feb-8e7e-7e6eee277f6c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.733212 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 340/670] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:41.734338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a3c5a-b90f-4439-bead-1ebee6d459d8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:41.765566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee73b5-741c-4bf0-968b-d45ffee625c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.766283 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee73b5-741c-4bf0-968b-d45ffee625c3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.766564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee73b5-741c-4bf0-968b-d45ffee625c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.766835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee73b5-741c-4bf0-968b-d45ffee625c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.774219 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee73b5-741c-4bf0-968b-d45ffee625c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.775756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee73b5-741c-4bf0-968b-d45ffee625c3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e3ee73b5-741c-4bf0-968b-d45ffee625c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:41.789842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:41.790777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:41.791670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:41.791670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:41.791670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:41.791670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:41.791670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:41.791670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:41.791670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:41.791670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:41.791670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 331/671] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:41.792199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee73b5-741c-4bf0-968b-d45ffee625c3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:41.802424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:41.850218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a3c5a-b90f-4439-bead-1ebee6d459d8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.885753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94b3b2-7f4f-46c5-a3bd-427d235f1b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.886401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94b3b2-7f4f-46c5-a3bd-427d235f1b88 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.886789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94b3b2-7f4f-46c5-a3bd-427d235f1b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.887062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94b3b2-7f4f-46c5-a3bd-427d235f1b88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.898226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee73b5-741c-4bf0-968b-d45ffee625c3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:41.937327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a09c3-60aa-4614-8d5b-b2dfdf4f98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:41.938131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a09c3-60aa-4614-8d5b-b2dfdf4f98fc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:41.938415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a09c3-60aa-4614-8d5b-b2dfdf4f98fc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:41.938687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a09c3-60aa-4614-8d5b-b2dfdf4f98fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:41.946715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a09c3-60aa-4614-8d5b-b2dfdf4f98fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.948151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a09c3-60aa-4614-8d5b-b2dfdf4f98fc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.951280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:41.962334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94b3b2-7f4f-46c5-a3bd-427d235f1b88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:41.963784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94b3b2-7f4f-46c5-a3bd-427d235f1b88 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d55a09c3-60aa-4614-8d5b-b2dfdf4f98fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:41.963952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:41.965055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:41.965933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:41.965933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:41.965933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:41.965933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:41.965933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:41.965933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:41.965933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:41.965933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:41.965933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 332/672] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:41.966426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a09c3-60aa-4614-8d5b-b2dfdf4f98fc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:42.034380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:42.071675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a09c3-60aa-4614-8d5b-b2dfdf4f98fc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:42.082912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 341/673] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:42.083749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94b3b2-7f4f-46c5-a3bd-427d235f1b88 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:42.111786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271deeb-dba6-4c7d-9c32-db9a98267d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:42.112802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271deeb-dba6-4c7d-9c32-db9a98267d25 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.113185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271deeb-dba6-4c7d-9c32-db9a98267d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.113517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271deeb-dba6-4c7d-9c32-db9a98267d25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.120626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271deeb-dba6-4c7d-9c32-db9a98267d25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:42.122084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271deeb-dba6-4c7d-9c32-db9a98267d25 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f271deeb-dba6-4c7d-9c32-db9a98267d25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:42.136469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:42.137492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 333/674] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:42.138464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271deeb-dba6-4c7d-9c32-db9a98267d25 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:42.182951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:42.192542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94b3b2-7f4f-46c5-a3bd-427d235f1b88 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:42.227567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9f0d7-d5ed-46b7-894c-52c744cc2b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:42.228226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9f0d7-d5ed-46b7-894c-52c744cc2b76 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.228507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9f0d7-d5ed-46b7-894c-52c744cc2b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.228818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9f0d7-d5ed-46b7-894c-52c744cc2b76 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.229608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9f0d7-d5ed-46b7-894c-52c744cc2b76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:42.229979 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9f0d7-d5ed-46b7-894c-52c744cc2b76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:42.231343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9f0d7-d5ed-46b7-894c-52c744cc2b76 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:42.239100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271deeb-dba6-4c7d-9c32-db9a98267d25 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:42.243564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 342/675] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:42.244838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af56c5a-5ef7-45e9-a019-c76b14d6cebf None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.245126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af56c5a-5ef7-45e9-a019-c76b14d6cebf None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.245401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af56c5a-5ef7-45e9-a019-c76b14d6cebf None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.246613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 343/676] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:42.247296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af56c5a-5ef7-45e9-a019-c76b14d6cebf None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:42.269157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:42.279090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52f575-d80f-455f-8b83-accdf9e67a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:42.279763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52f575-d80f-455f-8b83-accdf9e67a2b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.280054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52f575-d80f-455f-8b83-accdf9e67a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.280330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52f575-d80f-455f-8b83-accdf9e67a2b None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.281156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52f575-d80f-455f-8b83-accdf9e67a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:42.281470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52f575-d80f-455f-8b83-accdf9e67a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:42.283165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52f575-d80f-455f-8b83-accdf9e67a2b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:42.295732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 334/677] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:42.296474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52f575-d80f-455f-8b83-accdf9e67a2b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:42.371215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af56c5a-5ef7-45e9-a019-c76b14d6cebf None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:42.401296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52f575-d80f-455f-8b83-accdf9e67a2b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:42.405503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fdfb8-d6f8-4ba8-9215-d3c7a7b820fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:42.406288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fdfb8-d6f8-4ba8-9215-d3c7a7b820fd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.406568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fdfb8-d6f8-4ba8-9215-d3c7a7b820fd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.406840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fdfb8-d6f8-4ba8-9215-d3c7a7b820fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.417831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fdfb8-d6f8-4ba8-9215-d3c7a7b820fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:42.419269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fdfb8-d6f8-4ba8-9215-d3c7a7b820fd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-ec0fdfb8-d6f8-4ba8-9215-d3c7a7b820fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:42.436917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:42.438018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:42.439419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:42.439419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:42.439419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:42.439419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:42.439419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 344/678] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:42.440683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fdfb8-d6f8-4ba8-9215-d3c7a7b820fd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:42.442866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb4b5e-a054-48a2-94b9-b344bc430316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:42.443543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb4b5e-a054-48a2-94b9-b344bc430316 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.443824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb4b5e-a054-48a2-94b9-b344bc430316 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.444095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb4b5e-a054-48a2-94b9-b344bc430316 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.444975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb4b5e-a054-48a2-94b9-b344bc430316 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:42.445244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:42.445340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb4b5e-a054-48a2-94b9-b344bc430316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:42.446702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb4b5e-a054-48a2-94b9-b344bc430316 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:42.465057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 335/679] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jul 14 09:05:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:42.466283 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4f79-92a8-4e6b-8775-f481d3768d8e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.466572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4f79-92a8-4e6b-8775-f481d3768d8e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.466854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4f79-92a8-4e6b-8775-f481d3768d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.483411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d5cc4f79-92a8-4e6b-8775-f481d3768d8e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:42.484586 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d5cc4f79-92a8-4e6b-8775-f481d3768d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:42.525173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:42.548333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fdfb8-d6f8-4ba8-9215-d3c7a7b820fd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:42.552090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 336/680] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:42.552911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4f79-92a8-4e6b-8775-f481d3768d8e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:42.588675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627090-ab59-4527-bbf0-ecfd79e21319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:42.589342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627090-ab59-4527-bbf0-ecfd79e21319 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.589627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627090-ab59-4527-bbf0-ecfd79e21319 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.589905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627090-ab59-4527-bbf0-ecfd79e21319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.590730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627090-ab59-4527-bbf0-ecfd79e21319 None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=4f9b12f6e7e347e19e5183d7e45b162f) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:42.591039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627090-ab59-4527-bbf0-ecfd79e21319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:42.592469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627090-ab59-4527-bbf0-ecfd79e21319 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:42.598878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 345/681] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:42 2022] GET /identity/v3/role_assignments?user.id=4f9b12f6e7e347e19e5183d7e45b162f&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:42.599647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627090-ab59-4527-bbf0-ecfd79e21319 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:42.657407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4f79-92a8-4e6b-8775-f481d3768d8e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:42.692897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:42.702066 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a71c9-0ff3-47cb-95bd-57b152c3ac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:42.702689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a71c9-0ff3-47cb-95bd-57b152c3ac76 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.702969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a71c9-0ff3-47cb-95bd-57b152c3ac76 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.703238 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a71c9-0ff3-47cb-95bd-57b152c3ac76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.704104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a71c9-0ff3-47cb-95bd-57b152c3ac76 None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=66f1d95bcc534f4e945fc2c5be046a5f) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:42.704409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a71c9-0ff3-47cb-95bd-57b152c3ac76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:42.705887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a71c9-0ff3-47cb-95bd-57b152c3ac76 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:42.720718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 337/682] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:42 2022] GET /identity/v3/role_assignments?user.id=66f1d95bcc534f4e945fc2c5be046a5f&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:42.720718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a71c9-0ff3-47cb-95bd-57b152c3ac76 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:42.756636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627090-ab59-4527-bbf0-ecfd79e21319 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:42.767038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:42.807458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b38296-f148-4de2-ad20-88d9626a044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:42.808174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b38296-f148-4de2-ad20-88d9626a044e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.808628 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b38296-f148-4de2-ad20-88d9626a044e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.809096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b38296-f148-4de2-ad20-88d9626a044e None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.809967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b38296-f148-4de2-ad20-88d9626a044e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:42.810280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b38296-f148-4de2-ad20-88d9626a044e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:42.811685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b38296-f148-4de2-ad20-88d9626a044e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:42.830520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 346/683] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:42.831775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b38296-f148-4de2-ad20-88d9626a044e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:42.850999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a71c9-0ff3-47cb-95bd-57b152c3ac76 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:42.897043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099eb63-d000-4dab-880d-41ce2598ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:42.897704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099eb63-d000-4dab-880d-41ce2598ebfe None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:42.897982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099eb63-d000-4dab-880d-41ce2598ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:42.898250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099eb63-d000-4dab-880d-41ce2598ebfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:42.967505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b38296-f148-4de2-ad20-88d9626a044e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:43.000345 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:43.005076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099eb63-d000-4dab-880d-41ce2598ebfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:43.007490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099eb63-d000-4dab-880d-41ce2598ebfe None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:43.010006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884007e-4777-4da6-a279-1e250538b012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:43.010813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884007e-4777-4da6-a279-1e250538b012 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:43.011119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884007e-4777-4da6-a279-1e250538b012 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:43.011367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884007e-4777-4da6-a279-1e250538b012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:43.022258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884007e-4777-4da6-a279-1e250538b012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:43.023729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884007e-4777-4da6-a279-1e250538b012 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2884007e-4777-4da6-a279-1e250538b012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:43.044610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:43.045627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:43.046518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:43.046518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:43.046518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:43.046518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:43.046518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 347/684] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:43.047217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884007e-4777-4da6-a279-1e250538b012 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:43.061978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:43.127142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 338/685] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:43.128402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099eb63-d000-4dab-880d-41ce2598ebfe None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:43.178822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884007e-4777-4da6-a279-1e250538b012 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:43.214557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff00f-62a5-4b22-bd7a-bcc41791ed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:43.215448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff00f-62a5-4b22-bd7a-bcc41791ed45 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:43.215731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff00f-62a5-4b22-bd7a-bcc41791ed45 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:43.216042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff00f-62a5-4b22-bd7a-bcc41791ed45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:43.223444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ff00f-62a5-4b22-bd7a-bcc41791ed45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:43.224946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ff00f-62a5-4b22-bd7a-bcc41791ed45 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b95ff00f-62a5-4b22-bd7a-bcc41791ed45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:43.240122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:43.241100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:43.242016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:43.242016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:43.242016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:43.242016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:43.242016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:43.242016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:43.242016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:43.242016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:43.242016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 348/686] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:43.242515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff00f-62a5-4b22-bd7a-bcc41791ed45 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:43.264135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099eb63-d000-4dab-880d-41ce2598ebfe None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:43.287518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:43.312195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4897f6-a349-40f8-a29f-65fb1aa44b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:43.313139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4897f6-a349-40f8-a29f-65fb1aa44b13 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:43.313576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4897f6-a349-40f8-a29f-65fb1aa44b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:43.314235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4897f6-a349-40f8-a29f-65fb1aa44b13 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:43.315722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4897f6-a349-40f8-a29f-65fb1aa44b13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:43.316193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4897f6-a349-40f8-a29f-65fb1aa44b13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:43.317987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4897f6-a349-40f8-a29f-65fb1aa44b13 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:43.326782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:43.335445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 339/687] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:43.336805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4897f6-a349-40f8-a29f-65fb1aa44b13 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:43.355354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff00f-62a5-4b22-bd7a-bcc41791ed45 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:43.399945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5becf48-9827-446c-ba5d-99cbdb2691a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:43.400942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5becf48-9827-446c-ba5d-99cbdb2691a7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:43.401342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5becf48-9827-446c-ba5d-99cbdb2691a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:43.401713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5becf48-9827-446c-ba5d-99cbdb2691a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:43.413870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5becf48-9827-446c-ba5d-99cbdb2691a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:43.415496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5becf48-9827-446c-ba5d-99cbdb2691a7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c5becf48-9827-446c-ba5d-99cbdb2691a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:43.433854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:43.434990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:43.436090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:43.436090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:43.436090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:43.436090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:43.437543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 349/688] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:43.438635 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5becf48-9827-446c-ba5d-99cbdb2691a7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:43.469001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4897f6-a349-40f8-a29f-65fb1aa44b13 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:43.514359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b360cc-6499-4a20-9076-28fca14e8d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:43.515301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b360cc-6499-4a20-9076-28fca14e8d70 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:43.515726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b360cc-6499-4a20-9076-28fca14e8d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:43.516136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b360cc-6499-4a20-9076-28fca14e8d70 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:43.517081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b360cc-6499-4a20-9076-28fca14e8d70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:43.517552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b360cc-6499-4a20-9076-28fca14e8d70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:43.519895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b360cc-6499-4a20-9076-28fca14e8d70 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:43.536410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:43.538167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 340/689] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:43.539500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b360cc-6499-4a20-9076-28fca14e8d70 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:43.547547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5becf48-9827-446c-ba5d-99cbdb2691a7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:43.593437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc06c21-72ee-4a29-84f0-90d97eda467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:43.594183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc06c21-72ee-4a29-84f0-90d97eda467d None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:43.594567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc06c21-72ee-4a29-84f0-90d97eda467d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:43.594961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc06c21-72ee-4a29-84f0-90d97eda467d None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:43.595784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc06c21-72ee-4a29-84f0-90d97eda467d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:43.597728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc06c21-72ee-4a29-84f0-90d97eda467d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:43.603515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:43.621884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 350/690] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:05:43 2022] POST /identity/v3/users => generated 254 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:05:43.622867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc06c21-72ee-4a29-84f0-90d97eda467d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:43.655518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b360cc-6499-4a20-9076-28fca14e8d70 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:43.696911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd747e-52b7-40f4-a165-d028f24a601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:43.698017 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd747e-52b7-40f4-a165-d028f24a601c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:43.698442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd747e-52b7-40f4-a165-d028f24a601c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:43.698910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd747e-52b7-40f4-a165-d028f24a601c None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:43.699787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd747e-52b7-40f4-a165-d028f24a601c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:43.700320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd747e-52b7-40f4-a165-d028f24a601c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:43.702047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd747e-52b7-40f4-a165-d028f24a601c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:43.715867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 341/691] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:43.721787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd747e-52b7-40f4-a165-d028f24a601c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:43.752467 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc06c21-72ee-4a29-84f0-90d97eda467d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:43.798207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86fdc7-aa2d-4a7b-b6c2-062f4d07db5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:43.799052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fdc7-aa2d-4a7b-b6c2-062f4d07db5c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:43.799717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fdc7-aa2d-4a7b-b6c2-062f4d07db5c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:43.800109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fdc7-aa2d-4a7b-b6c2-062f4d07db5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:43.801089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86fdc7-aa2d-4a7b-b6c2-062f4d07db5c None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=60db5d8bc4cb4ce7af8bfac2c4eb2390) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:43.801501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86fdc7-aa2d-4a7b-b6c2-062f4d07db5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:43.804029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86fdc7-aa2d-4a7b-b6c2-062f4d07db5c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:43.813311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 351/692] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:43 2022] GET /identity/v3/role_assignments?user.id=60db5d8bc4cb4ce7af8bfac2c4eb2390&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:43.842745 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd747e-52b7-40f4-a165-d028f24a601c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:43.864884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:43.893408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d34d7-ea75-4ad7-96ce-62136f2ebc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:43.894916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d34d7-ea75-4ad7-96ce-62136f2ebc77 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:43.895442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d34d7-ea75-4ad7-96ce-62136f2ebc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:43.895920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d34d7-ea75-4ad7-96ce-62136f2ebc77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:43.905048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d34d7-ea75-4ad7-96ce-62136f2ebc77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:43.906886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d34d7-ea75-4ad7-96ce-62136f2ebc77 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-045d34d7-ea75-4ad7-96ce-62136f2ebc77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:43.924999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:43.926223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:43.927164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:43.927164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:43.927164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:43.927164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:43.927164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:43.927164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:43.927164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:43.927164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:43.927164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 342/693] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:43.933892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86fdc7-aa2d-4a7b-b6c2-062f4d07db5c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:43.961924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:44.060743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86fdc7-aa2d-4a7b-b6c2-062f4d07db5c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:44.096857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6e00c-aceb-4548-b39b-ada2738eea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:44.097537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6e00c-aceb-4548-b39b-ada2738eea73 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:44.097819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6e00c-aceb-4548-b39b-ada2738eea73 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:44.098095 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6e00c-aceb-4548-b39b-ada2738eea73 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:44.098897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6e00c-aceb-4548-b39b-ada2738eea73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:44.099207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6e00c-aceb-4548-b39b-ada2738eea73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:44.100645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6e00c-aceb-4548-b39b-ada2738eea73 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:44.115445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 352/694] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:44.121261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d34d7-ea75-4ad7-96ce-62136f2ebc77 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:44.246648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d34d7-ea75-4ad7-96ce-62136f2ebc77 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:44.291017 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce5cc0-2541-4390-b539-35a312f04c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:44.291675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce5cc0-2541-4390-b539-35a312f04c87 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:44.291956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce5cc0-2541-4390-b539-35a312f04c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:44.292229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce5cc0-2541-4390-b539-35a312f04c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:44.293084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce5cc0-2541-4390-b539-35a312f04c87 None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=2dab40ef1f8d4f5abf10b92e99e04122) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:44.293396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce5cc0-2541-4390-b539-35a312f04c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:44.294812 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce5cc0-2541-4390-b539-35a312f04c87 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:44.305516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 343/695] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:44 2022] GET /identity/v3/role_assignments?user.id=2dab40ef1f8d4f5abf10b92e99e04122&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:44.990355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81058d-ce0b-49b8-8443-4befa9498123 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:44.990875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81058d-ce0b-49b8-8443-4befa9498123 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:44.990979 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81058d-ce0b-49b8-8443-4befa9498123 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:44.992288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 353/696] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:44.997697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc5e17-b7c6-4fca-aa62-165a12fb0297 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:44.998111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc5e17-b7c6-4fca-aa62-165a12fb0297 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:44.998295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc5e17-b7c6-4fca-aa62-165a12fb0297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:45.021031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-bfcc5e17-b7c6-4fca-aa62-165a12fb0297 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:45.022242 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bfcc5e17-b7c6-4fca-aa62-165a12fb0297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:45.023611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431ac4a-ca80-4bf6-9b70-8d22160ade63 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:45.023900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431ac4a-ca80-4bf6-9b70-8d22160ade63 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:45.024193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431ac4a-ca80-4bf6-9b70-8d22160ade63 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:45.026940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 354/697] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:45.032444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed61233-3147-4dfe-adba-1418914ee8f4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:45.033676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed61233-3147-4dfe-adba-1418914ee8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:45.033977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed61233-3147-4dfe-adba-1418914ee8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:45.060020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9ed61233-3147-4dfe-adba-1418914ee8f4 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:45.061268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9ed61233-3147-4dfe-adba-1418914ee8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:45.082230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:45.134605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 344/698] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:45.165888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc5e17-b7c6-4fca-aa62-165a12fb0297 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:45.270446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 355/699] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:05:45.309661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed61233-3147-4dfe-adba-1418914ee8f4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:45.312832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:45.395073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc5e17-b7c6-4fca-aa62-165a12fb0297 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:45.466018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a695b-6cf8-4f99-af72-c455e18dcef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:45.466838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a695b-6cf8-4f99-af72-c455e18dcef2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:45.467120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a695b-6cf8-4f99-af72-c455e18dcef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:45.467395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a695b-6cf8-4f99-af72-c455e18dcef2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:45.482732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed61233-3147-4dfe-adba-1418914ee8f4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:45.494816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a695b-6cf8-4f99-af72-c455e18dcef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-128a695b-6cf8-4f99-af72-c455e18dcef2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:45.505041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:45.505982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:45.506805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:45.511086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 345/700] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:45.511924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a695b-6cf8-4f99-af72-c455e18dcef2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:45.539973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69553b53-2748-4b11-8e72-8fbe90807bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:45.540736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69553b53-2748-4b11-8e72-8fbe90807bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:45.541024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69553b53-2748-4b11-8e72-8fbe90807bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:45.541294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69553b53-2748-4b11-8e72-8fbe90807bc8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:45.541958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69553b53-2748-4b11-8e72-8fbe90807bc8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:45.543327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69553b53-2748-4b11-8e72-8fbe90807bc8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-69553b53-2748-4b11-8e72-8fbe90807bc8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:45.569945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:45.572187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:45.574213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 356/701] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Jul 14 09:05:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:45.583760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69553b53-2748-4b11-8e72-8fbe90807bc8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:45.585081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:45.687523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a695b-6cf8-4f99-af72-c455e18dcef2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:45.712971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:45.731225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f34b64-0e33-49f4-bef5-3e52d01df302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:45.731909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34b64-0e33-49f4-bef5-3e52d01df302 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:45.732193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34b64-0e33-49f4-bef5-3e52d01df302 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:45.732470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f34b64-0e33-49f4-bef5-3e52d01df302 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:45.734486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f34b64-0e33-49f4-bef5-3e52d01df302 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:45.734799 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f34b64-0e33-49f4-bef5-3e52d01df302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:45.736168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f34b64-0e33-49f4-bef5-3e52d01df302 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:45.759240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 346/702] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:45.760979 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69553b53-2748-4b11-8e72-8fbe90807bc8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:45.765549 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f34b64-0e33-49f4-bef5-3e52d01df302 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:45.826813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b82a2e-745d-4216-9dbf-ef1892e26e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:45.827413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82a2e-745d-4216-9dbf-ef1892e26e4f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:45.827698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82a2e-745d-4216-9dbf-ef1892e26e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:45.827976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82a2e-745d-4216-9dbf-ef1892e26e4f None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:45.828720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b82a2e-745d-4216-9dbf-ef1892e26e4f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:45.829030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b82a2e-745d-4216-9dbf-ef1892e26e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:45.830484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b82a2e-745d-4216-9dbf-ef1892e26e4f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:45.842866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 357/703] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jul 14 09:05:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:45.848715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b82a2e-745d-4216-9dbf-ef1892e26e4f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:45.871392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:45.878772 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f34b64-0e33-49f4-bef5-3e52d01df302 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:45.913509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07040e-b78a-4fda-8771-1d82e983a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:45.914316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07040e-b78a-4fda-8771-1d82e983a224 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:45.914599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07040e-b78a-4fda-8771-1d82e983a224 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:45.914871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07040e-b78a-4fda-8771-1d82e983a224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:45.926295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07040e-b78a-4fda-8771-1d82e983a224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:45.927757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07040e-b78a-4fda-8771-1d82e983a224 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-9a07040e-b78a-4fda-8771-1d82e983a224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:45.945730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:45.946662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:45.948099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:45.948099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:45.948099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:45.948099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:45.948099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 347/704] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:45.954266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07040e-b78a-4fda-8771-1d82e983a224 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:46.031467 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b82a2e-745d-4216-9dbf-ef1892e26e4f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:46.089125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:46.102122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723aac2b-1b38-4814-901b-c06e5e96f9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:46.102805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aac2b-1b38-4814-901b-c06e5e96f9ec None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.103090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aac2b-1b38-4814-901b-c06e5e96f9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.103373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aac2b-1b38-4814-901b-c06e5e96f9ec None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.104094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723aac2b-1b38-4814-901b-c06e5e96f9ec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:46.104403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723aac2b-1b38-4814-901b-c06e5e96f9ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:46.105808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723aac2b-1b38-4814-901b-c06e5e96f9ec None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:46.117812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 358/705] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jul 14 09:05:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:46.161312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07040e-b78a-4fda-8771-1d82e983a224 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:46.182061 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568e619-d657-48ac-b3c7-b5bc615ad8d9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.182721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568e619-d657-48ac-b3c7-b5bc615ad8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.183202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568e619-d657-48ac-b3c7-b5bc615ad8d9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.186336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 359/706] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:05:46.191522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d5c6-1cde-452c-9799-3386dc87dc29 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.192140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d5c6-1cde-452c-9799-3386dc87dc29 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.192613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d5c6-1cde-452c-9799-3386dc87dc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.219660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3082d5c6-1cde-452c-9799-3386dc87dc29 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:46.221290 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3082d5c6-1cde-452c-9799-3386dc87dc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:46.224449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed2ec-d7e5-48e8-95f6-4a1a956dcf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:46.226176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed2ec-d7e5-48e8-95f6-4a1a956dcf4a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.226473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed2ec-d7e5-48e8-95f6-4a1a956dcf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.226756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed2ec-d7e5-48e8-95f6-4a1a956dcf4a None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.227502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed2ec-d7e5-48e8-95f6-4a1a956dcf4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:46.227814 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed2ec-d7e5-48e8-95f6-4a1a956dcf4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:46.229227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed2ec-d7e5-48e8-95f6-4a1a956dcf4a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:46.259102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 348/707] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:46.264812 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed2ec-d7e5-48e8-95f6-4a1a956dcf4a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:46.285084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:46.352828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 360/708] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:46.387282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082d5c6-1cde-452c-9799-3386dc87dc29 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:46.397010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed2ec-d7e5-48e8-95f6-4a1a956dcf4a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:46.466907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b1899-d722-44d3-984f-3bc9d10b5ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:46.467728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1899-d722-44d3-984f-3bc9d10b5ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.468011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1899-d722-44d3-984f-3bc9d10b5ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.468284 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1899-d722-44d3-984f-3bc9d10b5ef0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.488797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b1899-d722-44d3-984f-3bc9d10b5ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:46.490356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b1899-d722-44d3-984f-3bc9d10b5ef0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-573b1899-d722-44d3-984f-3bc9d10b5ef0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:46.512931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:46.513926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:46.514873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 349/709] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jul 14 09:05:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:46.525607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b1899-d722-44d3-984f-3bc9d10b5ef0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:46.551406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082d5c6-1cde-452c-9799-3386dc87dc29 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:46.581636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:46.594563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016937-5f11-4013-84e6-2453a9b498eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:46.595605 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016937-5f11-4013-84e6-2453a9b498eb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.596074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016937-5f11-4013-84e6-2453a9b498eb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.596437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016937-5f11-4013-84e6-2453a9b498eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.603314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:46.610985 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016937-5f11-4013-84e6-2453a9b498eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-44016937-5f11-4013-84e6-2453a9b498eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:46.620192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:46.621146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:46.621998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:46.624908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 361/710] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:46.626350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a64162-3d15-4d19-9b76-61ca43990436 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.626892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a64162-3d15-4d19-9b76-61ca43990436 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.627550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a64162-3d15-4d19-9b76-61ca43990436 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.629515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 362/711] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:46.631014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a64162-3d15-4d19-9b76-61ca43990436 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:46.641188 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b1899-d722-44d3-984f-3bc9d10b5ef0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:46.687420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329819e-a717-42a6-aaa3-ef2a4e53a766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:46.688353 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329819e-a717-42a6-aaa3-ef2a4e53a766 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.688640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329819e-a717-42a6-aaa3-ef2a4e53a766 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.688950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329819e-a717-42a6-aaa3-ef2a4e53a766 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.689869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329819e-a717-42a6-aaa3-ef2a4e53a766 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:46.690237 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329819e-a717-42a6-aaa3-ef2a4e53a766 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:46.692246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329819e-a717-42a6-aaa3-ef2a4e53a766 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:46.721126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 350/712] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jul 14 09:05:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:46.722540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c07ad-6654-4f88-a625-038719e9c77d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.722834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c07ad-6654-4f88-a625-038719e9c77d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.723118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c07ad-6654-4f88-a625-038719e9c77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.744315 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3f6c07ad-6654-4f88-a625-038719e9c77d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:46.745924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3f6c07ad-6654-4f88-a625-038719e9c77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:46.755840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a64162-3d15-4d19-9b76-61ca43990436 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:46.803667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1e53d-0aa3-4de4-8302-47ba94c89029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:46.804400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1e53d-0aa3-4de4-8302-47ba94c89029 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.804707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1e53d-0aa3-4de4-8302-47ba94c89029 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.804992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1e53d-0aa3-4de4-8302-47ba94c89029 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.805804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1e53d-0aa3-4de4-8302-47ba94c89029 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:46.806112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1e53d-0aa3-4de4-8302-47ba94c89029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:46.808076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1e53d-0aa3-4de4-8302-47ba94c89029 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:46.820401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 363/713] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:46.821324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1e53d-0aa3-4de4-8302-47ba94c89029 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:46.822682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 351/714] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:46.825653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c07ad-6654-4f88-a625-038719e9c77d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:46.889124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:46.891823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:46.942220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c07ad-6654-4f88-a625-038719e9c77d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:46.971165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1e53d-0aa3-4de4-8302-47ba94c89029 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:46.978487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d0842-7858-4d7e-b4be-aa625401dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:46.979561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d0842-7858-4d7e-b4be-aa625401dbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:46.980043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d0842-7858-4d7e-b4be-aa625401dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:46.980536 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d0842-7858-4d7e-b4be-aa625401dbb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:46.991918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d0842-7858-4d7e-b4be-aa625401dbb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:46.993663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d0842-7858-4d7e-b4be-aa625401dbb6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-013d0842-7858-4d7e-b4be-aa625401dbb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:47.012463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:47.013510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:47.014459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:47.014459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:47.014459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:47.014459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:47.014738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dd82a-63a4-45d0-8020-bfb703d6cb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:47.014738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dd82a-63a4-45d0-8020-bfb703d6cb6f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.014738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dd82a-63a4-45d0-8020-bfb703d6cb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.014947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dd82a-63a4-45d0-8020-bfb703d6cb6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.017275 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 352/715] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:47.018341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d0842-7858-4d7e-b4be-aa625401dbb6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:47.113452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dd82a-63a4-45d0-8020-bfb703d6cb6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:47.115124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dd82a-63a4-45d0-8020-bfb703d6cb6f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:47.125203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d0842-7858-4d7e-b4be-aa625401dbb6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:47.133926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:47.164235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0e198-8d4b-4fce-b09c-53fb3c244a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:47.165823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0e198-8d4b-4fce-b09c-53fb3c244a9a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.166352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0e198-8d4b-4fce-b09c-53fb3c244a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.166840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0e198-8d4b-4fce-b09c-53fb3c244a9a None admin] PATH_INFO: `/v3/services/network` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.167715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0e198-8d4b-4fce-b09c-53fb3c244a9a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:47.169321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0e198-8d4b-4fce-b09c-53fb3c244a9a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:47.174775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f5a0e198-8d4b-4fce-b09c-53fb3c244a9a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:47.184104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:47.185239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:05:47.186155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:47.188941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 353/716] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:47 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:47.190366 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0e198-8d4b-4fce-b09c-53fb3c244a9a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:47.244743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 364/717] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:47.245980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dd82a-63a4-45d0-8020-bfb703d6cb6f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:47.307253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0e198-8d4b-4fce-b09c-53fb3c244a9a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:47.344456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6f98e-d718-43a8-a2b3-13384bcdfd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:47.345151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6f98e-d718-43a8-a2b3-13384bcdfd62 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.345433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6f98e-d718-43a8-a2b3-13384bcdfd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.345805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6f98e-d718-43a8-a2b3-13384bcdfd62 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.346616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6f98e-d718-43a8-a2b3-13384bcdfd62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:47.346926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6f98e-d718-43a8-a2b3-13384bcdfd62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:47.348469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6f98e-d718-43a8-a2b3-13384bcdfd62 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:47.360459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dd82a-63a4-45d0-8020-bfb703d6cb6f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:47.366787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 354/718] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:47.369086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6f98e-d718-43a8-a2b3-13384bcdfd62 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:47.402333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e023891-7085-4476-a0df-89fa0fdff803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:47.403149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023891-7085-4476-a0df-89fa0fdff803 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.403428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023891-7085-4476-a0df-89fa0fdff803 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.403968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:47.404078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023891-7085-4476-a0df-89fa0fdff803 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.405516 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e023891-7085-4476-a0df-89fa0fdff803 None admin] RBAC: Adding query filter params (name=network) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:47.405818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e023891-7085-4476-a0df-89fa0fdff803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:47.407189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e023891-7085-4476-a0df-89fa0fdff803 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:47.412896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 365/719] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:05:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:47.414234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac54e-2641-4615-b778-d5b8c871017b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.414581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac54e-2641-4615-b778-d5b8c871017b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.414803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac54e-2641-4615-b778-d5b8c871017b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.416269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 366/720] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:47.417050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaac54e-2641-4615-b778-d5b8c871017b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:47.429799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:47.488514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6f98e-d718-43a8-a2b3-13384bcdfd62 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:47.525148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429d1da-09ab-4f23-a307-8d458f3b4f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:47.526137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d1da-09ab-4f23-a307-8d458f3b4f12 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.526476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d1da-09ab-4f23-a307-8d458f3b4f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.526684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d1da-09ab-4f23-a307-8d458f3b4f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.527097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaac54e-2641-4615-b778-d5b8c871017b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:47.537439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429d1da-09ab-4f23-a307-8d458f3b4f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:47.538978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429d1da-09ab-4f23-a307-8d458f3b4f12 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-6429d1da-09ab-4f23-a307-8d458f3b4f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:47.559047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:47.559935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:47.561531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:47.561531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:47.561531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:47.561531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:47.561531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 355/721] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:47.561531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429d1da-09ab-4f23-a307-8d458f3b4f12 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:47.567918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a091d8a-dce6-4302-915f-9814fe6fcea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:47.568770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a091d8a-dce6-4302-915f-9814fe6fcea4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.569052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a091d8a-dce6-4302-915f-9814fe6fcea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.569325 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a091d8a-dce6-4302-915f-9814fe6fcea4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.577566 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a091d8a-dce6-4302-915f-9814fe6fcea4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:47.579085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a091d8a-dce6-4302-915f-9814fe6fcea4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5a091d8a-dce6-4302-915f-9814fe6fcea4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:47.595205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:47.596291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 367/722] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jul 14 09:05:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2adc05-1ec1-4b7b-a4ca-6be9bab7d6fd None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.598314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2adc05-1ec1-4b7b-a4ca-6be9bab7d6fd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.599031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2adc05-1ec1-4b7b-a4ca-6be9bab7d6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.614312 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-aa2adc05-1ec1-4b7b-a4ca-6be9bab7d6fd None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:47.615485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-aa2adc05-1ec1-4b7b-a4ca-6be9bab7d6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:47.649621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:47.669646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429d1da-09ab-4f23-a307-8d458f3b4f12 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:47.682349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:47.687877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 368/723] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:47.688770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2adc05-1ec1-4b7b-a4ca-6be9bab7d6fd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:47.715608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af896a-5ede-447d-9f1a-353e58b3ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:47.716278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af896a-5ede-447d-9f1a-353e58b3ab54 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.716559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af896a-5ede-447d-9f1a-353e58b3ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.716860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af896a-5ede-447d-9f1a-353e58b3ab54 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.717556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af896a-5ede-447d-9f1a-353e58b3ab54 None admin] RBAC: Adding query filter params (type=network) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:47.717869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af896a-5ede-447d-9f1a-353e58b3ab54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:47.719233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af896a-5ede-447d-9f1a-353e58b3ab54 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:47.725194 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 356/724] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:05:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:47.725911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af896a-5ede-447d-9f1a-353e58b3ab54 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:47.805114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2adc05-1ec1-4b7b-a4ca-6be9bab7d6fd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:47.844187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07fe68-76d0-4b9b-9c87-4826a3d6dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:47.844905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fe68-76d0-4b9b-9c87-4826a3d6dc87 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.845186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fe68-76d0-4b9b-9c87-4826a3d6dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.845511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fe68-76d0-4b9b-9c87-4826a3d6dc87 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.846253 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07fe68-76d0-4b9b-9c87-4826a3d6dc87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:47.846559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07fe68-76d0-4b9b-9c87-4826a3d6dc87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:47.848250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07fe68-76d0-4b9b-9c87-4826a3d6dc87 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:47.865565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 369/725] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:47.865565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07fe68-76d0-4b9b-9c87-4826a3d6dc87 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:47.879434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af896a-5ede-447d-9f1a-353e58b3ab54 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:47.919340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369701d-be51-4776-9e0e-99b1ab2c2bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:47.920388 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369701d-be51-4776-9e0e-99b1ab2c2bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:47.920900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369701d-be51-4776-9e0e-99b1ab2c2bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:47.921489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369701d-be51-4776-9e0e-99b1ab2c2bc1 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:47.922496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369701d-be51-4776-9e0e-99b1ab2c2bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:47.922951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369701d-be51-4776-9e0e-99b1ab2c2bc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:47.925007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369701d-be51-4776-9e0e-99b1ab2c2bc1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:47.929752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:47.946332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 357/726] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jul 14 09:05:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:47.951675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369701d-be51-4776-9e0e-99b1ab2c2bc1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:47.955920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:47.990355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07fe68-76d0-4b9b-9c87-4826a3d6dc87 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:48.037602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398802-6e83-4fee-b08b-cbd6b2d21744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:48.038718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398802-6e83-4fee-b08b-cbd6b2d21744 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.039674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398802-6e83-4fee-b08b-cbd6b2d21744 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.040105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398802-6e83-4fee-b08b-cbd6b2d21744 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.055917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398802-6e83-4fee-b08b-cbd6b2d21744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-bb398802-6e83-4fee-b08b-cbd6b2d21744 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:48.066319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:48.067528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:48.068576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:48.075773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 370/727] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:48.075773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398802-6e83-4fee-b08b-cbd6b2d21744 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:48.078474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369701d-be51-4776-9e0e-99b1ab2c2bc1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:48.119639 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c5032-0a1a-46e7-8436-9bc7022ebec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:48.121276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c5032-0a1a-46e7-8436-9bc7022ebec9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.121276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c5032-0a1a-46e7-8436-9bc7022ebec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.121526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c5032-0a1a-46e7-8436-9bc7022ebec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.130024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c5032-0a1a-46e7-8436-9bc7022ebec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:48.131562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c5032-0a1a-46e7-8436-9bc7022ebec9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-9a1c5032-0a1a-46e7-8436-9bc7022ebec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:48.147935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:48.148927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:48.149841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:48.149841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:48.149841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:48.149841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:48.149841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:48.149841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:48.149841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:48.149841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:48.153988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 358/728] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:48.155244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c5032-0a1a-46e7-8436-9bc7022ebec9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:48.198239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398802-6e83-4fee-b08b-cbd6b2d21744 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:48.221821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:48.238193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f258c-b65c-4ec3-b1ab-c85b4c023c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:48.239227 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f258c-b65c-4ec3-b1ab-c85b4c023c9a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.239711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f258c-b65c-4ec3-b1ab-c85b4c023c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.240183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f258c-b65c-4ec3-b1ab-c85b4c023c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.253048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:48.287086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c5032-0a1a-46e7-8436-9bc7022ebec9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:48.316339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f258c-b65c-4ec3-b1ab-c85b4c023c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:48.317912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f258c-b65c-4ec3-b1ab-c85b4c023c9a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:48.325084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709a959-86d3-4943-ba6c-78a0cded3484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:48.325761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a959-86d3-4943-ba6c-78a0cded3484 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.326037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a959-86d3-4943-ba6c-78a0cded3484 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.326307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a959-86d3-4943-ba6c-78a0cded3484 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.327057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709a959-86d3-4943-ba6c-78a0cded3484 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:48.327359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709a959-86d3-4943-ba6c-78a0cded3484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:48.328723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709a959-86d3-4943-ba6c-78a0cded3484 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:48.341085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 359/729] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:48.341085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709a959-86d3-4943-ba6c-78a0cded3484 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:48.433186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 371/730] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:48.434884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9e6b-1e27-414c-a5ac-482348467af8 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.435374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9e6b-1e27-414c-a5ac-482348467af8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.435872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9e6b-1e27-414c-a5ac-482348467af8 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.441255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 372/731] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:48.441690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9e6b-1e27-414c-a5ac-482348467af8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:48.454394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709a959-86d3-4943-ba6c-78a0cded3484 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:48.466674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:48.482539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:48.491695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d456c-d7ea-42fc-8e63-a241c8a37779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:48.492365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d456c-d7ea-42fc-8e63-a241c8a37779 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.492650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d456c-d7ea-42fc-8e63-a241c8a37779 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.492969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d456c-d7ea-42fc-8e63-a241c8a37779 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.493791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d456c-d7ea-42fc-8e63-a241c8a37779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:48.494079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d456c-d7ea-42fc-8e63-a241c8a37779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:48.495522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d456c-d7ea-42fc-8e63-a241c8a37779 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:48.508637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 360/732] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:48.510265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d456c-d7ea-42fc-8e63-a241c8a37779 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:48.561508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9e6b-1e27-414c-a5ac-482348467af8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:48.599139 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f893a6-caf8-462a-a893-cef95eacffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:48.600023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f893a6-caf8-462a-a893-cef95eacffdb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.600301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f893a6-caf8-462a-a893-cef95eacffdb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.600568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f893a6-caf8-462a-a893-cef95eacffdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.611921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f893a6-caf8-462a-a893-cef95eacffdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:48.613436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f893a6-caf8-462a-a893-cef95eacffdb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:48.614383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d456c-d7ea-42fc-8e63-a241c8a37779 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-31f893a6-caf8-462a-a893-cef95eacffdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:48.631700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:48.632602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:48.633531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:48.633531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:48.633531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:48.633531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:48.633531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 373/733] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:48.634512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591aae1-cca7-4047-ae0d-b80228933c68 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.634791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591aae1-cca7-4047-ae0d-b80228933c68 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.635063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591aae1-cca7-4047-ae0d-b80228933c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.654363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3591aae1-cca7-4047-ae0d-b80228933c68 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:48.655405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4dcc0-21e1-4c8f-abdc-d78b34658a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:48.655554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3591aae1-cca7-4047-ae0d-b80228933c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:48.656241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4dcc0-21e1-4c8f-abdc-d78b34658a9a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.656526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4dcc0-21e1-4c8f-abdc-d78b34658a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.656831 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4dcc0-21e1-4c8f-abdc-d78b34658a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.669324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4dcc0-21e1-4c8f-abdc-d78b34658a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:48.670779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4dcc0-21e1-4c8f-abdc-d78b34658a9a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-4da4dcc0-21e1-4c8f-abdc-d78b34658a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:48.689378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:48.690837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:48.692387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:48.692387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:48.692387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:48.692387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:48.692387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 361/734] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:48.692387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4dcc0-21e1-4c8f-abdc-d78b34658a9a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:48.732431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 374/735] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:48.733294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591aae1-cca7-4047-ae0d-b80228933c68 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:48.735568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:48.753827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:48.814788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4dcc0-21e1-4c8f-abdc-d78b34658a9a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:48.848535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591aae1-cca7-4047-ae0d-b80228933c68 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:48.849597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e47d-ce0d-48fa-a1e0-2ee2f8d2381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:48.850260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e47d-ce0d-48fa-a1e0-2ee2f8d2381e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.850541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e47d-ce0d-48fa-a1e0-2ee2f8d2381e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.850828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e47d-ce0d-48fa-a1e0-2ee2f8d2381e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.851656 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20e47d-ce0d-48fa-a1e0-2ee2f8d2381e None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=66f1d95bcc534f4e945fc2c5be046a5f) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:48.851965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20e47d-ce0d-48fa-a1e0-2ee2f8d2381e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:48.853422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20e47d-ce0d-48fa-a1e0-2ee2f8d2381e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:48.871333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 362/736] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:48 2022] GET /identity/v3/role_assignments?user.id=66f1d95bcc534f4e945fc2c5be046a5f&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:48.871333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e47d-ce0d-48fa-a1e0-2ee2f8d2381e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:48.893426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698eeee-d6a1-446c-bf7d-330562877626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:48.894190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698eeee-d6a1-446c-bf7d-330562877626 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:48.894474 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698eeee-d6a1-446c-bf7d-330562877626 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:48.894749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698eeee-d6a1-446c-bf7d-330562877626 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:48.895595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698eeee-d6a1-446c-bf7d-330562877626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:48.895908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698eeee-d6a1-446c-bf7d-330562877626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:48.897369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698eeee-d6a1-446c-bf7d-330562877626 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:48.911244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 375/737] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:48.912181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698eeee-d6a1-446c-bf7d-330562877626 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:48.981029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:48.992600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e47d-ce0d-48fa-a1e0-2ee2f8d2381e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:48.994769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:49.032640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698eeee-d6a1-446c-bf7d-330562877626 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:49.034263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6767e84-dc0d-4855-86d7-7d6b092bf1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:49.034951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6767e84-dc0d-4855-86d7-7d6b092bf1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:49.035236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6767e84-dc0d-4855-86d7-7d6b092bf1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:49.035621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6767e84-dc0d-4855-86d7-7d6b092bf1f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:49.036371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6767e84-dc0d-4855-86d7-7d6b092bf1f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:49.036685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6767e84-dc0d-4855-86d7-7d6b092bf1f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:49.038227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6767e84-dc0d-4855-86d7-7d6b092bf1f8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:49.056815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 363/738] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:49.057356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6767e84-dc0d-4855-86d7-7d6b092bf1f8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:49.083387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79d6df-1389-4143-a969-6a4272deba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:49.084058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d6df-1389-4143-a969-6a4272deba6e None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:49.084339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d6df-1389-4143-a969-6a4272deba6e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:49.084613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d6df-1389-4143-a969-6a4272deba6e None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:49.085396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79d6df-1389-4143-a969-6a4272deba6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:49.087319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79d6df-1389-4143-a969-6a4272deba6e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:49.113040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 376/739] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:05:48 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:05:49.114021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79d6df-1389-4143-a969-6a4272deba6e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:49.280338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6767e84-dc0d-4855-86d7-7d6b092bf1f8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:49.331024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79d6df-1389-4143-a969-6a4272deba6e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:49.342075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5819f2-2788-4a57-94d7-825658a4da1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:49.343361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5819f2-2788-4a57-94d7-825658a4da1e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:49.343654 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5819f2-2788-4a57-94d7-825658a4da1e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:49.343931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5819f2-2788-4a57-94d7-825658a4da1e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:49.353453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:49.356051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5819f2-2788-4a57-94d7-825658a4da1e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:49.359557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5819f2-2788-4a57-94d7-825658a4da1e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-0a5819f2-2788-4a57-94d7-825658a4da1e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:49.379377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:49.380354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:49.381414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:49.381414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:49.381414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:49.381414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:49.381414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:49.381414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:49.381414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:49.381414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:49.381414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:05:49.381414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:49.381968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7b674-7156-4882-b9c6-2e31dbf0a652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:49.381968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7b674-7156-4882-b9c6-2e31dbf0a652 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:49.381968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7b674-7156-4882-b9c6-2e31dbf0a652 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:49.381968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7b674-7156-4882-b9c6-2e31dbf0a652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:49.382244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 364/740] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:49.388282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5819f2-2788-4a57-94d7-825658a4da1e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:49.390482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7b674-7156-4882-b9c6-2e31dbf0a652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:49.392358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7b674-7156-4882-b9c6-2e31dbf0a652 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5ff7b674-7156-4882-b9c6-2e31dbf0a652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:49.411656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:49.412651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:49.413590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:49.413590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:49.413590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:49.413590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:49.413590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:49.413590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:49.413590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:49.413590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:49.413590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 377/741] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:49.419557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7b674-7156-4882-b9c6-2e31dbf0a652 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:49.420243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:49.564784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5819f2-2788-4a57-94d7-825658a4da1e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:49.612560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7b674-7156-4882-b9c6-2e31dbf0a652 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:49.613312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fceb2-7b9c-4abe-8aca-05f4ae3e4d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:49.613989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fceb2-7b9c-4abe-8aca-05f4ae3e4d74 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:49.614264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fceb2-7b9c-4abe-8aca-05f4ae3e4d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:49.614530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fceb2-7b9c-4abe-8aca-05f4ae3e4d74 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:49.615366 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fceb2-7b9c-4abe-8aca-05f4ae3e4d74 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:49.615669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fceb2-7b9c-4abe-8aca-05f4ae3e4d74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:49.617131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fceb2-7b9c-4abe-8aca-05f4ae3e4d74 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:49.656577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 365/742] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jul 14 09:05:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:49.661533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fceb2-7b9c-4abe-8aca-05f4ae3e4d74 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:49.687685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b9857-2a22-47c2-90ba-9b350bf67e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:49.688414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b9857-2a22-47c2-90ba-9b350bf67e98 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:49.688810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b9857-2a22-47c2-90ba-9b350bf67e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:49.689304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b9857-2a22-47c2-90ba-9b350bf67e98 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:49.690111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b9857-2a22-47c2-90ba-9b350bf67e98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:49.690417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b9857-2a22-47c2-90ba-9b350bf67e98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:49.691849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b9857-2a22-47c2-90ba-9b350bf67e98 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:49.724742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 378/743] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:49.736240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b9857-2a22-47c2-90ba-9b350bf67e98 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:49.803699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:49.809035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:49.833050 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fceb2-7b9c-4abe-8aca-05f4ae3e4d74 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:49.868065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67155766-4973-4771-b43b-20882e91048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:49.868732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67155766-4973-4771-b43b-20882e91048f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:49.869014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67155766-4973-4771-b43b-20882e91048f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:49.869284 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67155766-4973-4771-b43b-20882e91048f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:49.879546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b9857-2a22-47c2-90ba-9b350bf67e98 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:49.917300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008b28a-2cce-483d-9876-934093346f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:49.918491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b28a-2cce-483d-9876-934093346f8c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:49.918996 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b28a-2cce-483d-9876-934093346f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:49.919477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b28a-2cce-483d-9876-934093346f8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:49.920518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008b28a-2cce-483d-9876-934093346f8c None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=6c7099627b964e91870043f512b8b7dc) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:49.921199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008b28a-2cce-483d-9876-934093346f8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:49.922884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008b28a-2cce-483d-9876-934093346f8c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:49.929661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 379/744] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:49 2022] GET /identity/v3/role_assignments?user.id=6c7099627b964e91870043f512b8b7dc&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:49.931255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b05e1-1c86-4c4f-b1f0-6f39543524af None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:49.931749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b05e1-1c86-4c4f-b1f0-6f39543524af None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:49.932247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b05e1-1c86-4c4f-b1f0-6f39543524af None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:49.933941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 380/745] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:49.940437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a8cb-46ea-49c6-b07c-3eba635a0b9e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:49.942258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a8cb-46ea-49c6-b07c-3eba635a0b9e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:49.942543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a8cb-46ea-49c6-b07c-3eba635a0b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:49.945329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67155766-4973-4771-b43b-20882e91048f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:49.946811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67155766-4973-4771-b43b-20882e91048f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:49.968471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c659a8cb-46ea-49c6-b07c-3eba635a0b9e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:49.970592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c659a8cb-46ea-49c6-b07c-3eba635a0b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:50.082030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:50.098882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 381/746] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:05:50.117182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 366/747] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:49 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:05:50.123396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659a8cb-46ea-49c6-b07c-3eba635a0b9e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:50.141185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67155766-4973-4771-b43b-20882e91048f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:50.177977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:50.304272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659a8cb-46ea-49c6-b07c-3eba635a0b9e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:50.330060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67155766-4973-4771-b43b-20882e91048f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:50.351126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb554309-34d1-4bda-88fe-7f7e4b9e9703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:50.351869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554309-34d1-4bda-88fe-7f7e4b9e9703 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:50.352146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554309-34d1-4bda-88fe-7f7e4b9e9703 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:50.352419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554309-34d1-4bda-88fe-7f7e4b9e9703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:50.371997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb554309-34d1-4bda-88fe-7f7e4b9e9703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:50.375809 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb554309-34d1-4bda-88fe-7f7e4b9e9703 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-bb554309-34d1-4bda-88fe-7f7e4b9e9703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:50.397922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:50.398823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:50.399705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:50.399705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:50.399705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:50.399705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:50.399933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c0b3-d5f2-4b4b-99b5-8a86a4080df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:50.399933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c0b3-d5f2-4b4b-99b5-8a86a4080df2 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:50.399933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c0b3-d5f2-4b4b-99b5-8a86a4080df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:50.399933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c0b3-d5f2-4b4b-99b5-8a86a4080df2 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:50.400196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 382/748] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:50.400272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8c0b3-d5f2-4b4b-99b5-8a86a4080df2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:50.404750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8c0b3-d5f2-4b4b-99b5-8a86a4080df2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:50.408008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb554309-34d1-4bda-88fe-7f7e4b9e9703 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:50.422784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 367/749] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:05:50 2022] POST /identity/v3/services => generated 240 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:05:50.566660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb554309-34d1-4bda-88fe-7f7e4b9e9703 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:50.575126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:50.625489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57461d6c-e568-4d7c-b5fa-d282e0c3561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:50.626779 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57461d6c-e568-4d7c-b5fa-d282e0c3561e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:50.627340 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57461d6c-e568-4d7c-b5fa-d282e0c3561e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:50.627813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57461d6c-e568-4d7c-b5fa-d282e0c3561e None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:50.628799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57461d6c-e568-4d7c-b5fa-d282e0c3561e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:50.629301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57461d6c-e568-4d7c-b5fa-d282e0c3561e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:50.630937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57461d6c-e568-4d7c-b5fa-d282e0c3561e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:50.644788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 383/750] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:50.650130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c0b3-d5f2-4b4b-99b5-8a86a4080df2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:50.696893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:50.759409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c0b3-d5f2-4b4b-99b5-8a86a4080df2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:50.795296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5280b-bb8f-44bc-99e3-5152827c3085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:50.796148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5280b-bb8f-44bc-99e3-5152827c3085 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:50.796428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5280b-bb8f-44bc-99e3-5152827c3085 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:50.796725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5280b-bb8f-44bc-99e3-5152827c3085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:50.804185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5280b-bb8f-44bc-99e3-5152827c3085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:50.805652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5280b-bb8f-44bc-99e3-5152827c3085 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-35d5280b-bb8f-44bc-99e3-5152827c3085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:50.820590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:50.821567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:50.822475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:50.822475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:50.822475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:50.822475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:50.822475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:50.822475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:50.822475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:50.822475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:50.822475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 368/751] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:50.829696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57461d6c-e568-4d7c-b5fa-d282e0c3561e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:50.956402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57461d6c-e568-4d7c-b5fa-d282e0c3561e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:51.006018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a82d6-46f4-415f-8594-a762ce129caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:51.006701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a82d6-46f4-415f-8594-a762ce129caa None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:51.006982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a82d6-46f4-415f-8594-a762ce129caa None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:51.007256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a82d6-46f4-415f-8594-a762ce129caa None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:51.008142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a82d6-46f4-415f-8594-a762ce129caa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:51.008450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a82d6-46f4-415f-8594-a762ce129caa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:51.009924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a82d6-46f4-415f-8594-a762ce129caa None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:51.026678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:51.032271 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 384/752] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:51.041798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5280b-bb8f-44bc-99e3-5152827c3085 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:51.194590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:51.198991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5280b-bb8f-44bc-99e3-5152827c3085 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:51.221016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133eabc-d29b-4f6b-a88f-aa1da08af0cd None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:51.221639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133eabc-d29b-4f6b-a88f-aa1da08af0cd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:51.222165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133eabc-d29b-4f6b-a88f-aa1da08af0cd None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:51.223738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 385/753] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:05:51.229151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a0a7a-e2c5-495c-92d1-149e18bfbaea None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:51.229671 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a0a7a-e2c5-495c-92d1-149e18bfbaea None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:51.230276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a0a7a-e2c5-495c-92d1-149e18bfbaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:51.241746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016222c-9452-4470-bb5f-3db53c3ed087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:51.243243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016222c-9452-4470-bb5f-3db53c3ed087 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:51.243544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016222c-9452-4470-bb5f-3db53c3ed087 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:51.243827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016222c-9452-4470-bb5f-3db53c3ed087 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:51.244691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016222c-9452-4470-bb5f-3db53c3ed087 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=2dab40ef1f8d4f5abf10b92e99e04122) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:51.245018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016222c-9452-4470-bb5f-3db53c3ed087 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:51.246467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016222c-9452-4470-bb5f-3db53c3ed087 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:51.252995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 369/754] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:51 2022] GET /identity/v3/role_assignments?user.id=2dab40ef1f8d4f5abf10b92e99e04122&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:51.270796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d34a0a7a-e2c5-495c-92d1-149e18bfbaea None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:51.272273 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d34a0a7a-e2c5-495c-92d1-149e18bfbaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:51.395504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 386/755] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:05:51.435269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016222c-9452-4470-bb5f-3db53c3ed087 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:51.566541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016222c-9452-4470-bb5f-3db53c3ed087 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:51.618781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c01b27-a2ff-4542-b090-4d1a4c4ef62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:51.619600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01b27-a2ff-4542-b090-4d1a4c4ef62e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:51.619888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01b27-a2ff-4542-b090-4d1a4c4ef62e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:51.620163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01b27-a2ff-4542-b090-4d1a4c4ef62e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:51.634923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c01b27-a2ff-4542-b090-4d1a4c4ef62e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d4c01b27-a2ff-4542-b090-4d1a4c4ef62e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:51.642891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:51.643820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:51.644687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:51.646868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 370/756] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:51.652041 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a0a7a-e2c5-495c-92d1-149e18bfbaea None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:51.772186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a0a7a-e2c5-495c-92d1-149e18bfbaea None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:51.802175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:51.808583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45907ab1-3ceb-4587-b8ae-3f7d34fe739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:51.809303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45907ab1-3ceb-4587-b8ae-3f7d34fe739b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:51.809637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45907ab1-3ceb-4587-b8ae-3f7d34fe739b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:51.809919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45907ab1-3ceb-4587-b8ae-3f7d34fe739b None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:51.810683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45907ab1-3ceb-4587-b8ae-3f7d34fe739b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:51.810997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45907ab1-3ceb-4587-b8ae-3f7d34fe739b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:51.812424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45907ab1-3ceb-4587-b8ae-3f7d34fe739b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:51.825100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 387/757] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:51.827383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c01b27-a2ff-4542-b090-4d1a4c4ef62e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:51.864839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7a584-0053-47fc-9ae1-a8159db3336e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:51.865153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7a584-0053-47fc-9ae1-a8159db3336e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:51.865395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7a584-0053-47fc-9ae1-a8159db3336e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:51.867035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 388/758] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:51.869141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:51.873847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcc72-24b3-4929-ab85-c9c6e6d4b3b2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:51.874138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcc72-24b3-4929-ab85-c9c6e6d4b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:51.874632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcc72-24b3-4929-ab85-c9c6e6d4b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:51.898113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-79adcc72-24b3-4929-ab85-c9c6e6d4b3b2 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:51.899374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-79adcc72-24b3-4929-ab85-c9c6e6d4b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:51.989703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c01b27-a2ff-4542-b090-4d1a4c4ef62e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:52.058206 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f7ce2-1377-4a9d-bc9b-56002e47d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:52.059063 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f7ce2-1377-4a9d-bc9b-56002e47d112 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:52.059351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f7ce2-1377-4a9d-bc9b-56002e47d112 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:52.059629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f7ce2-1377-4a9d-bc9b-56002e47d112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:52.061587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 389/759] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:05:52.072814 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f7ce2-1377-4a9d-bc9b-56002e47d112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:52.074277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f7ce2-1377-4a9d-bc9b-56002e47d112 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:52.093088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adcc72-24b3-4929-ab85-c9c6e6d4b3b2 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a16f7ce2-1377-4a9d-bc9b-56002e47d112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:52.104105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:52.106073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:52.108274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:52.108274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:52.108274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:52.108274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:52.108274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 371/760] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:52.111286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f7ce2-1377-4a9d-bc9b-56002e47d112 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:52.259359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:52.278499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adcc72-24b3-4929-ab85-c9c6e6d4b3b2 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:52.302192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f7ce2-1377-4a9d-bc9b-56002e47d112 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:52.322215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:52.341113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01613c3-a872-46af-b1eb-6d602fa126b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:52.342723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01613c3-a872-46af-b1eb-6d602fa126b6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:52.343016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01613c3-a872-46af-b1eb-6d602fa126b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:52.343343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01613c3-a872-46af-b1eb-6d602fa126b6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:52.343961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01613c3-a872-46af-b1eb-6d602fa126b6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:52.345402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01613c3-a872-46af-b1eb-6d602fa126b6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d01613c3-a872-46af-b1eb-6d602fa126b6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:52.360439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:52.362663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:52.364578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 390/761] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Jul 14 09:05:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:52.370741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01613c3-a872-46af-b1eb-6d602fa126b6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:52.382414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8177-e1fb-4e68-a798-8499ca0da9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:52.383100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8177-e1fb-4e68-a798-8499ca0da9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:52.383381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8177-e1fb-4e68-a798-8499ca0da9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:52.383653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8177-e1fb-4e68-a798-8499ca0da9b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:52.384391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d8177-e1fb-4e68-a798-8499ca0da9b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:52.391635 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d8177-e1fb-4e68-a798-8499ca0da9b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:52.391635 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d8177-e1fb-4e68-a798-8499ca0da9b3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:52.407791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 372/762] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:52.413752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8177-e1fb-4e68-a798-8499ca0da9b3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:52.591793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01613c3-a872-46af-b1eb-6d602fa126b6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:52.601991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8177-e1fb-4e68-a798-8499ca0da9b3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:52.628232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0cb52-f8c8-4530-90e0-62c7fc366202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:52.628932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0cb52-f8c8-4530-90e0-62c7fc366202 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:52.629217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0cb52-f8c8-4530-90e0-62c7fc366202 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:52.629493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0cb52-f8c8-4530-90e0-62c7fc366202 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:52.630203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0cb52-f8c8-4530-90e0-62c7fc366202 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:52.630506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0cb52-f8c8-4530-90e0-62c7fc366202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:52.631942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0cb52-f8c8-4530-90e0-62c7fc366202 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:52.637131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 391/763] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jul 14 09:05:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:52.638265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ec389-c0e6-4468-850d-9423b4e68053 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:52.638554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ec389-c0e6-4468-850d-9423b4e68053 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:52.638829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ec389-c0e6-4468-850d-9423b4e68053 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:52.648643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 392/764] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:52.648643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ec389-c0e6-4468-850d-9423b4e68053 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:52.653815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf1bfe-e0c0-4d03-a286-ae8c13586549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:52.654628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf1bfe-e0c0-4d03-a286-ae8c13586549 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:52.654908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf1bfe-e0c0-4d03-a286-ae8c13586549 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:52.655181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf1bfe-e0c0-4d03-a286-ae8c13586549 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:52.659023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:52.664268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf1bfe-e0c0-4d03-a286-ae8c13586549 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:52.666242 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf1bfe-e0c0-4d03-a286-ae8c13586549 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e8bf1bfe-e0c0-4d03-a286-ae8c13586549 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:52.683138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:52.684341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:52.685616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:52.685616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:52.685616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:52.685616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:52.685616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:52.685616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:52.685616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:52.685616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:52.685616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:52.685616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:52.687244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 373/765] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jul 14 09:05:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:52.688693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bacc-9151-4cda-abd5-9ba824bb5118 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:52.693784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bacc-9151-4cda-abd5-9ba824bb5118 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:52.694173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bacc-9151-4cda-abd5-9ba824bb5118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:52.711271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4660bacc-9151-4cda-abd5-9ba824bb5118 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:52.712642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4660bacc-9151-4cda-abd5-9ba824bb5118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:52.717787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:52.790393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ec389-c0e6-4468-850d-9423b4e68053 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:52.790628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 374/766] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:05:52.790628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660bacc-9151-4cda-abd5-9ba824bb5118 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:52.841424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69fdb7-8522-4fd7-b403-68b728043893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:52.842990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69fdb7-8522-4fd7-b403-68b728043893 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:52.842990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69fdb7-8522-4fd7-b403-68b728043893 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:52.842990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69fdb7-8522-4fd7-b403-68b728043893 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:52.843838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69fdb7-8522-4fd7-b403-68b728043893 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:52.844333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69fdb7-8522-4fd7-b403-68b728043893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:52.845968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69fdb7-8522-4fd7-b403-68b728043893 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:52.851902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 393/767] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jul 14 09:05:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:52.856916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69fdb7-8522-4fd7-b403-68b728043893 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:52.915698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660bacc-9151-4cda-abd5-9ba824bb5118 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:52.941797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:52.954722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3719007-0be4-4835-b221-a6293ef1ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:52.955405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3719007-0be4-4835-b221-a6293ef1ca79 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:52.955693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3719007-0be4-4835-b221-a6293ef1ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:52.955967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3719007-0be4-4835-b221-a6293ef1ca79 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:52.956848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3719007-0be4-4835-b221-a6293ef1ca79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:52.957160 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3719007-0be4-4835-b221-a6293ef1ca79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:52.958589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3719007-0be4-4835-b221-a6293ef1ca79 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:52.963705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69fdb7-8522-4fd7-b403-68b728043893 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:52.978346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 375/768] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jul 14 09:05:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:52.978977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3719007-0be4-4835-b221-a6293ef1ca79 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:52.985014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:53.007304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5724b1-b818-4935-b8d7-45a4a85da2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:53.008110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5724b1-b818-4935-b8d7-45a4a85da2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.008391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5724b1-b818-4935-b8d7-45a4a85da2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.008695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5724b1-b818-4935-b8d7-45a4a85da2f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.019733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5724b1-b818-4935-b8d7-45a4a85da2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-6d5724b1-b818-4935-b8d7-45a4a85da2f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:53.027717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:53.028681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:53.029527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 394/769] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:53.030610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b633f-e78e-46b2-a72c-30bba7aeb36b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.030610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b633f-e78e-46b2-a72c-30bba7aeb36b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.030800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b633f-e78e-46b2-a72c-30bba7aeb36b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.036474 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 395/770] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:53.036474 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b633f-e78e-46b2-a72c-30bba7aeb36b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:53.093839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3719007-0be4-4835-b221-a6293ef1ca79 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:53.129812 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a7d66-63f8-493a-b85c-3d2d605e4385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:53.130530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7d66-63f8-493a-b85c-3d2d605e4385 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.130825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7d66-63f8-493a-b85c-3d2d605e4385 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.131083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7d66-63f8-493a-b85c-3d2d605e4385 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.131886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a7d66-63f8-493a-b85c-3d2d605e4385 None admin] RBAC: Adding query filter params (interface=public, service_id=6abe092c76c648a5995a0fa905480946, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:53.132201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a7d66-63f8-493a-b85c-3d2d605e4385 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:53.133804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a7d66-63f8-493a-b85c-3d2d605e4385 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:53.143305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 376/771] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jul 14 09:05:52 2022] GET /identity/v3/endpoints?service_id=6abe092c76c648a5995a0fa905480946&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:53.144205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a7d66-63f8-493a-b85c-3d2d605e4385 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:53.145946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b633f-e78e-46b2-a72c-30bba7aeb36b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:53.188054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb3433-9e3c-43ae-94ca-8ab866061958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:53.188792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb3433-9e3c-43ae-94ca-8ab866061958 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.189072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb3433-9e3c-43ae-94ca-8ab866061958 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.189339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb3433-9e3c-43ae-94ca-8ab866061958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.200788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb3433-9e3c-43ae-94ca-8ab866061958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:53.202458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:53.203123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb3433-9e3c-43ae-94ca-8ab866061958 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-00bb3433-9e3c-43ae-94ca-8ab866061958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:53.221841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:53.222819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:53.223716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:53.223716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:53.223716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:53.223716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:53.223716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 396/772] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:53.224576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efa587-5f91-48db-9c86-2486be16f24f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.224576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efa587-5f91-48db-9c86-2486be16f24f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.224900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efa587-5f91-48db-9c86-2486be16f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.242706 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-74efa587-5f91-48db-9c86-2486be16f24f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:53.244432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-74efa587-5f91-48db-9c86-2486be16f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:53.270822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:53.273051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a7d66-63f8-493a-b85c-3d2d605e4385 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:53.314737 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451296a3-58a9-4f24-8a27-ba93980bd9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:53.315824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451296a3-58a9-4f24-8a27-ba93980bd9cd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.316255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451296a3-58a9-4f24-8a27-ba93980bd9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.316762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451296a3-58a9-4f24-8a27-ba93980bd9cd None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.317685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451296a3-58a9-4f24-8a27-ba93980bd9cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:53.318138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451296a3-58a9-4f24-8a27-ba93980bd9cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:53.319415 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 397/773] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:05:53.319827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451296a3-58a9-4f24-8a27-ba93980bd9cd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:53.320249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efa587-5f91-48db-9c86-2486be16f24f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:53.332576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 377/774] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:53.333641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451296a3-58a9-4f24-8a27-ba93980bd9cd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:53.441467 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efa587-5f91-48db-9c86-2486be16f24f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:53.461436 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451296a3-58a9-4f24-8a27-ba93980bd9cd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:53.472278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:53.476622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c7922-9ae0-4251-9eb0-a7d127777c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:53.477320 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c7922-9ae0-4251-9eb0-a7d127777c22 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.477599 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c7922-9ae0-4251-9eb0-a7d127777c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.477874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c7922-9ae0-4251-9eb0-a7d127777c22 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.478644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c7922-9ae0-4251-9eb0-a7d127777c22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:53.479916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c7922-9ae0-4251-9eb0-a7d127777c22 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:53.485080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 398/775] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jul 14 09:05:53 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:53.486051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c7922-9ae0-4251-9eb0-a7d127777c22 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:53.501808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b71906-56dd-4337-9c2b-a2f2d7c8c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:53.503018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b71906-56dd-4337-9c2b-a2f2d7c8c50a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.503504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b71906-56dd-4337-9c2b-a2f2d7c8c50a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.503970 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b71906-56dd-4337-9c2b-a2f2d7c8c50a None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.505306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b71906-56dd-4337-9c2b-a2f2d7c8c50a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:53.505625 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b71906-56dd-4337-9c2b-a2f2d7c8c50a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:53.507099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b71906-56dd-4337-9c2b-a2f2d7c8c50a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:53.519577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:53.528857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 378/776] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:53.530460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b71906-56dd-4337-9c2b-a2f2d7c8c50a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:53.610091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c7922-9ae0-4251-9eb0-a7d127777c22 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:53.637949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b71906-56dd-4337-9c2b-a2f2d7c8c50a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:53.651808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08cf2a-f7aa-45aa-b836-c10d44b3d4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:53.652609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08cf2a-f7aa-45aa-b836-c10d44b3d4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.652894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08cf2a-f7aa-45aa-b836-c10d44b3d4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.653165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08cf2a-f7aa-45aa-b836-c10d44b3d4f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.665134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08cf2a-f7aa-45aa-b836-c10d44b3d4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:53.666619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08cf2a-f7aa-45aa-b836-c10d44b3d4f0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:53.682782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29996dfe-d918-4758-806b-98837a9ad33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:53.683583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996dfe-d918-4758-806b-98837a9ad33b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.683861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996dfe-d918-4758-806b-98837a9ad33b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.684130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996dfe-d918-4758-806b-98837a9ad33b None admin] PATH_INFO: `/v3/services/network` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.684815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29996dfe-d918-4758-806b-98837a9ad33b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-eb08cf2a-f7aa-45aa-b836-c10d44b3d4f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:53.684930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:53.685764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:53.686683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:53.686683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:53.686683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:53.686683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:53.686912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29996dfe-d918-4758-806b-98837a9ad33b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:53.686985 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 399/777] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:53.687540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ff4ea-6ebd-4153-98c0-797840171a4e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.687910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ff4ea-6ebd-4153-98c0-797840171a4e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.688188 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ff4ea-6ebd-4153-98c0-797840171a4e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.690585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 400/778] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:53.690585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ff4ea-6ebd-4153-98c0-797840171a4e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-29996dfe-d918-4758-806b-98837a9ad33b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:53.701894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:53.702915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:05:53.703934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:53.711258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 379/779] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:53 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:53.711258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29996dfe-d918-4758-806b-98837a9ad33b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:53.750472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:53.766146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:53.797602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ff4ea-6ebd-4153-98c0-797840171a4e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:53.825789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29996dfe-d918-4758-806b-98837a9ad33b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:53.835113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8b650-d67e-4fd8-95ef-f33862af5da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:53.835946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b650-d67e-4fd8-95ef-f33862af5da1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.836224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b650-d67e-4fd8-95ef-f33862af5da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.836497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b650-d67e-4fd8-95ef-f33862af5da1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.844132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8b650-d67e-4fd8-95ef-f33862af5da1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:53.845805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8b650-d67e-4fd8-95ef-f33862af5da1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-03c8b650-d67e-4fd8-95ef-f33862af5da1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:53.860314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:53.861448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:53.862337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:53.862337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:53.862337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:53.862337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:53.862337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:53.862337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:53.862337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:53.862337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:53.862337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 401/780] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:53.862840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130abb-ea64-4cc9-916e-af85c803f50e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.863436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130abb-ea64-4cc9-916e-af85c803f50e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.863436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130abb-ea64-4cc9-916e-af85c803f50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.873779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9c469-f93b-443c-8a0a-86aacfd286eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:53.874448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9c469-f93b-443c-8a0a-86aacfd286eb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:53.875162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9c469-f93b-443c-8a0a-86aacfd286eb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:53.875460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9c469-f93b-443c-8a0a-86aacfd286eb None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:53.876187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9c469-f93b-443c-8a0a-86aacfd286eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:53.876531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9c469-f93b-443c-8a0a-86aacfd286eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:53.877884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9c469-f93b-443c-8a0a-86aacfd286eb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:53.880092 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-81130abb-ea64-4cc9-916e-af85c803f50e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:53.881357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-81130abb-ea64-4cc9-916e-af85c803f50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:53.894841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 380/781] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:53.894841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9c469-f93b-443c-8a0a-86aacfd286eb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:53.958949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 402/782] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:05:53.959609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130abb-ea64-4cc9-916e-af85c803f50e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.014444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:54.023701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9c469-f93b-443c-8a0a-86aacfd286eb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.026390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:54.062990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700f233-18da-436d-9b59-6de83e4414f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.063670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700f233-18da-436d-9b59-6de83e4414f0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.064003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700f233-18da-436d-9b59-6de83e4414f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.064267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700f233-18da-436d-9b59-6de83e4414f0 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.065044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700f233-18da-436d-9b59-6de83e4414f0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:54.065343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700f233-18da-436d-9b59-6de83e4414f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:54.066734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700f233-18da-436d-9b59-6de83e4414f0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:54.070594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130abb-ea64-4cc9-916e-af85c803f50e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.071304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 381/783] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:05:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:54.072078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700f233-18da-436d-9b59-6de83e4414f0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.111728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de8a35-4225-4801-9afb-a4c5bc8a4a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.112747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de8a35-4225-4801-9afb-a4c5bc8a4a69 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.113232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de8a35-4225-4801-9afb-a4c5bc8a4a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.113681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de8a35-4225-4801-9afb-a4c5bc8a4a69 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.114761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de8a35-4225-4801-9afb-a4c5bc8a4a69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:54.115137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de8a35-4225-4801-9afb-a4c5bc8a4a69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:54.116690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de8a35-4225-4801-9afb-a4c5bc8a4a69 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:54.129887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 403/784] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:54.130714 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de8a35-4225-4801-9afb-a4c5bc8a4a69 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.192087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700f233-18da-436d-9b59-6de83e4414f0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.229407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4f886-8409-4d03-a87b-039eb6a663cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.230140 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4f886-8409-4d03-a87b-039eb6a663cd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.230421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4f886-8409-4d03-a87b-039eb6a663cd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.230677 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4f886-8409-4d03-a87b-039eb6a663cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.238614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4f886-8409-4d03-a87b-039eb6a663cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:54.239529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de8a35-4225-4801-9afb-a4c5bc8a4a69 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.240052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4f886-8409-4d03-a87b-039eb6a663cd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a2a4f886-8409-4d03-a87b-039eb6a663cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:54.256911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:54.257870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:54.258815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 382/785] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jul 14 09:05:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:54.260042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4f886-8409-4d03-a87b-039eb6a663cd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.269487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:54.280073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:54.284346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5a591-25cf-4acf-a933-2d67e1b9417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.285322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5a591-25cf-4acf-a933-2d67e1b9417a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.285610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5a591-25cf-4acf-a933-2d67e1b9417a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.285884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5a591-25cf-4acf-a933-2d67e1b9417a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.296439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5a591-25cf-4acf-a933-2d67e1b9417a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-0cc5a591-25cf-4acf-a933-2d67e1b9417a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:54.304127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:54.305151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:54.306201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:54.310383 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 404/786] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:54.311063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5a591-25cf-4acf-a933-2d67e1b9417a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.381271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4f886-8409-4d03-a87b-039eb6a663cd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.416352 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5a591-25cf-4acf-a933-2d67e1b9417a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.419456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e997d-2e0e-471f-ab28-222f363570b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.420121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e997d-2e0e-471f-ab28-222f363570b2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.420407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e997d-2e0e-471f-ab28-222f363570b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.420703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e997d-2e0e-471f-ab28-222f363570b2 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.421415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e997d-2e0e-471f-ab28-222f363570b2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:54.421721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e997d-2e0e-471f-ab28-222f363570b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:54.423126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e997d-2e0e-471f-ab28-222f363570b2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:54.428167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 383/787] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:05:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:54.428975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e997d-2e0e-471f-ab28-222f363570b2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.458614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b1313-ff6a-41bc-986c-2bf749ccceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.459807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b1313-ff6a-41bc-986c-2bf749ccceb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.460289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b1313-ff6a-41bc-986c-2bf749ccceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.460865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b1313-ff6a-41bc-986c-2bf749ccceb9 None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/66f1d95bcc534f4e945fc2c5be046a5f/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.462947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b1313-ff6a-41bc-986c-2bf749ccceb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=66f1d95bcc534f4e945fc2c5be046a5f, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:54.464384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b1313-ff6a-41bc-986c-2bf749ccceb9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:54.478756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 405/788] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:05:54 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/66f1d95bcc534f4e945fc2c5be046a5f/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:54.479936 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b1313-ff6a-41bc-986c-2bf749ccceb9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.546509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:54.565033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:54.572804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e997d-2e0e-471f-ab28-222f363570b2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.615268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510800f6-9c26-46dd-a07d-b74317f4a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.615996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510800f6-9c26-46dd-a07d-b74317f4a0bd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.616277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510800f6-9c26-46dd-a07d-b74317f4a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.616548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510800f6-9c26-46dd-a07d-b74317f4a0bd None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.617880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510800f6-9c26-46dd-a07d-b74317f4a0bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:54.618192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510800f6-9c26-46dd-a07d-b74317f4a0bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:54.619659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510800f6-9c26-46dd-a07d-b74317f4a0bd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:54.638000 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b1313-ff6a-41bc-986c-2bf749ccceb9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.640320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 384/789] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jul 14 09:05:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:54.641380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510800f6-9c26-46dd-a07d-b74317f4a0bd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.676646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f4a51-fed6-4046-b239-d0c59ca2a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.677353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f4a51-fed6-4046-b239-d0c59ca2a4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.677635 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f4a51-fed6-4046-b239-d0c59ca2a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.677909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f4a51-fed6-4046-b239-d0c59ca2a4e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.678711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f4a51-fed6-4046-b239-d0c59ca2a4e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:54.679016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f4a51-fed6-4046-b239-d0c59ca2a4e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:54.680417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f4a51-fed6-4046-b239-d0c59ca2a4e3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:54.692865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 406/790] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:54.694095 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f4a51-fed6-4046-b239-d0c59ca2a4e3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.751597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510800f6-9c26-46dd-a07d-b74317f4a0bd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.788533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13f6fc-b5cc-4ca9-b195-ad851d48a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.789226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f6fc-b5cc-4ca9-b195-ad851d48a896 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.789508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f6fc-b5cc-4ca9-b195-ad851d48a896 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.789780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f6fc-b5cc-4ca9-b195-ad851d48a896 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.790572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13f6fc-b5cc-4ca9-b195-ad851d48a896 None admin] RBAC: Adding query filter params (interface=public, service_id=8d3596b2e44d4ab18ec5a086c51550b2, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:54.790879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13f6fc-b5cc-4ca9-b195-ad851d48a896 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:54.792241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13f6fc-b5cc-4ca9-b195-ad851d48a896 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:54.797714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 385/791] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jul 14 09:05:54 2022] GET /identity/v3/endpoints?service_id=8d3596b2e44d4ab18ec5a086c51550b2&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:54.802629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13f6fc-b5cc-4ca9-b195-ad851d48a896 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.806413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:54.815670 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f4a51-fed6-4046-b239-d0c59ca2a4e3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.818545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:54.860453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fad061-d724-4fa4-9014-261d42210ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.861422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fad061-d724-4fa4-9014-261d42210ebb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.861767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fad061-d724-4fa4-9014-261d42210ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.862109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fad061-d724-4fa4-9014-261d42210ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.874051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fad061-d724-4fa4-9014-261d42210ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:54.875693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fad061-d724-4fa4-9014-261d42210ebb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-22fad061-d724-4fa4-9014-261d42210ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:54.893378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:54.894317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:54.895231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:54.895231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:54.895231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:54.895231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:54.895231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 407/792] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:54.896606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fad061-d724-4fa4-9014-261d42210ebb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:54.932138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13f6fc-b5cc-4ca9-b195-ad851d48a896 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:54.977608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb14a0-aa6f-4c30-9daf-77be77beae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:54.978416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb14a0-aa6f-4c30-9daf-77be77beae3b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:54.978692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb14a0-aa6f-4c30-9daf-77be77beae3b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:54.978959 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb14a0-aa6f-4c30-9daf-77be77beae3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:54.995088 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb14a0-aa6f-4c30-9daf-77be77beae3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:54.997545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb14a0-aa6f-4c30-9daf-77be77beae3b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:55.005800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fad061-d724-4fa4-9014-261d42210ebb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-b6bb14a0-aa6f-4c30-9daf-77be77beae3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:55.024968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:55.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:55.026804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:55.026804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:55.026804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:55.026804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:55.029581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 386/793] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:55.031551 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb14a0-aa6f-4c30-9daf-77be77beae3b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:55.041831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88310d31-c65c-41ef-b310-1666225c78e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:55.042588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88310d31-c65c-41ef-b310-1666225c78e9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:55.042871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88310d31-c65c-41ef-b310-1666225c78e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:55.043437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88310d31-c65c-41ef-b310-1666225c78e9 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:55.043831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88310d31-c65c-41ef-b310-1666225c78e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:55.045244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88310d31-c65c-41ef-b310-1666225c78e9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:55.056684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 408/794] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jul 14 09:05:54 2022] GET /identity/v3/services => generated 772 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:55.056684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88310d31-c65c-41ef-b310-1666225c78e9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:55.097072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:55.143775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:55.235826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb14a0-aa6f-4c30-9daf-77be77beae3b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:55.261128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88310d31-c65c-41ef-b310-1666225c78e9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:55.279608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dcd1c-6ccd-4f14-ae96-05d5c232797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:55.280700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dcd1c-6ccd-4f14-ae96-05d5c232797b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:55.281547 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dcd1c-6ccd-4f14-ae96-05d5c232797b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:55.282028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dcd1c-6ccd-4f14-ae96-05d5c232797b None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:55.283037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dcd1c-6ccd-4f14-ae96-05d5c232797b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:55.283538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dcd1c-6ccd-4f14-ae96-05d5c232797b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:55.285164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dcd1c-6ccd-4f14-ae96-05d5c232797b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:55.298309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 387/795] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:55.303862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dcd1c-6ccd-4f14-ae96-05d5c232797b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:55.304135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e558a94-a6cb-4fd5-a69b-fe822881dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:55.304861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e558a94-a6cb-4fd5-a69b-fe822881dd8e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:55.305143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e558a94-a6cb-4fd5-a69b-fe822881dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:55.305417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e558a94-a6cb-4fd5-a69b-fe822881dd8e None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:55.306146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e558a94-a6cb-4fd5-a69b-fe822881dd8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:55.306449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e558a94-a6cb-4fd5-a69b-fe822881dd8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:55.307812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e558a94-a6cb-4fd5-a69b-fe822881dd8e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:55.321039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 409/796] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:55.327427 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e558a94-a6cb-4fd5-a69b-fe822881dd8e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:55.421224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:55.433723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dcd1c-6ccd-4f14-ae96-05d5c232797b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:55.442816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e558a94-a6cb-4fd5-a69b-fe822881dd8e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:55.453593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:55.481855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238a348-9b0b-49db-8e73-f78e1a02c2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:55.482648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238a348-9b0b-49db-8e73-f78e1a02c2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:55.482931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238a348-9b0b-49db-8e73-f78e1a02c2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:55.483204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238a348-9b0b-49db-8e73-f78e1a02c2e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:55.496957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f08b68-c231-42ff-998d-1f5cb7b74c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:55.497769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08b68-c231-42ff-998d-1f5cb7b74c7a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:55.498048 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08b68-c231-42ff-998d-1f5cb7b74c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:55.498323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08b68-c231-42ff-998d-1f5cb7b74c7a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:55.499630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238a348-9b0b-49db-8e73-f78e1a02c2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:55.501166 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238a348-9b0b-49db-8e73-f78e1a02c2e8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:55.515495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f08b68-c231-42ff-998d-1f5cb7b74c7a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:55.516954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f08b68-c231-42ff-998d-1f5cb7b74c7a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-7238a348-9b0b-49db-8e73-f78e1a02c2e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:55.525647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:55.527286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 388/797] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf14d32-7b2f-4bfd-a62f-0643ea9cde31 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:55.529331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf14d32-7b2f-4bfd-a62f-0643ea9cde31 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:55.531600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf14d32-7b2f-4bfd-a62f-0643ea9cde31 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:55.535407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 389/798] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:55.535407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf14d32-7b2f-4bfd-a62f-0643ea9cde31 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d2f08b68-c231-42ff-998d-1f5cb7b74c7a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:55.546743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:55.548977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 410/799] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647fbb7-0362-4e15-9b5b-91d0f5c72b54 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:55.550925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647fbb7-0362-4e15-9b5b-91d0f5c72b54 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:55.552001 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647fbb7-0362-4e15-9b5b-91d0f5c72b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:55.571529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5647fbb7-0362-4e15-9b5b-91d0f5c72b54 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:55.573013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5647fbb7-0362-4e15-9b5b-91d0f5c72b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:55.645667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 411/800] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:05:55.647249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647fbb7-0362-4e15-9b5b-91d0f5c72b54 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:55.693125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf14d32-7b2f-4bfd-a62f-0643ea9cde31 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:55.729956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23498c3-06c3-40ed-bef0-9a2aed726932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:55.730962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23498c3-06c3-40ed-bef0-9a2aed726932 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:55.731393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23498c3-06c3-40ed-bef0-9a2aed726932 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:55.731824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23498c3-06c3-40ed-bef0-9a2aed726932 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:55.732817 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23498c3-06c3-40ed-bef0-9a2aed726932 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:55.733286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23498c3-06c3-40ed-bef0-9a2aed726932 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:55.735744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23498c3-06c3-40ed-bef0-9a2aed726932 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:55.744984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:55.750647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 390/801] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:55.751663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23498c3-06c3-40ed-bef0-9a2aed726932 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:55.790691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647fbb7-0362-4e15-9b5b-91d0f5c72b54 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:55.796461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:55.832343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e88c-bc29-4760-b69f-b780cc455352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:55.833436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e88c-bc29-4760-b69f-b780cc455352 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:55.834062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e88c-bc29-4760-b69f-b780cc455352 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:55.834539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e88c-bc29-4760-b69f-b780cc455352 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:55.836122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37e88c-bc29-4760-b69f-b780cc455352 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:55.836913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37e88c-bc29-4760-b69f-b780cc455352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:55.839498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37e88c-bc29-4760-b69f-b780cc455352 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:55.860019 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 412/802] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jul 14 09:05:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:55.860879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e88c-bc29-4760-b69f-b780cc455352 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:55.876177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23498c3-06c3-40ed-bef0-9a2aed726932 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:55.912644 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176f921-3d04-4f2f-9062-daf7250f2a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:55.913931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f921-3d04-4f2f-9062-daf7250f2a31 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:55.914412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f921-3d04-4f2f-9062-daf7250f2a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:55.914880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f921-3d04-4f2f-9062-daf7250f2a31 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:55.915864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176f921-3d04-4f2f-9062-daf7250f2a31 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:55.917582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176f921-3d04-4f2f-9062-daf7250f2a31 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-4176f921-3d04-4f2f-9062-daf7250f2a31 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:55.931004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:55.931991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:05:55.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:55.940464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 391/803] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Jul 14 09:05:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:55.941641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176f921-3d04-4f2f-9062-daf7250f2a31 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:55.971616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e88c-bc29-4760-b69f-b780cc455352 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:55.999770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:56.008716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d431b9-92bf-45d2-a0af-81609e5164b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:56.010184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d431b9-92bf-45d2-a0af-81609e5164b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:56.010687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d431b9-92bf-45d2-a0af-81609e5164b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:56.011048 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d431b9-92bf-45d2-a0af-81609e5164b9 None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/6c7099627b964e91870043f512b8b7dc/roles/14d87e5720e84adba77d427eed713973` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:56.028341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d431b9-92bf-45d2-a0af-81609e5164b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=6c7099627b964e91870043f512b8b7dc, role_id=14d87e5720e84adba77d427eed713973)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:56.031763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d431b9-92bf-45d2-a0af-81609e5164b9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:56.053078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 413/804] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:05:55 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/6c7099627b964e91870043f512b8b7dc/roles/14d87e5720e84adba77d427eed713973 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:56.053078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d431b9-92bf-45d2-a0af-81609e5164b9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:56.060760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:56.064573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176f921-3d04-4f2f-9062-daf7250f2a31 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:56.127554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78650-fa1f-4ad3-90fd-ba9143ef239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:56.128799 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78650-fa1f-4ad3-90fd-ba9143ef239e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:56.129229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78650-fa1f-4ad3-90fd-ba9143ef239e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:56.129644 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78650-fa1f-4ad3-90fd-ba9143ef239e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:56.151501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d78650-fa1f-4ad3-90fd-ba9143ef239e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:56.153354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d78650-fa1f-4ad3-90fd-ba9143ef239e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:56.166232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d431b9-92bf-45d2-a0af-81609e5164b9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-b0d78650-fa1f-4ad3-90fd-ba9143ef239e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:56.181685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:56.182784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:56.183915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:56.183915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:56.183915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:56.183915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:56.194633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 392/805] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:56.200431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78650-fa1f-4ad3-90fd-ba9143ef239e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:56.208354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7a751-8ceb-4388-b2cb-ea94b961761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:56.209660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a751-8ceb-4388-b2cb-ea94b961761b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:56.214875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a751-8ceb-4388-b2cb-ea94b961761b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:56.214875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a751-8ceb-4388-b2cb-ea94b961761b None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:56.214875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7a751-8ceb-4388-b2cb-ea94b961761b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:56.214875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7a751-8ceb-4388-b2cb-ea94b961761b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:56.214875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7a751-8ceb-4388-b2cb-ea94b961761b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:56.220002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 414/806] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jul 14 09:05:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:56.229503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7a751-8ceb-4388-b2cb-ea94b961761b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:56.324134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78650-fa1f-4ad3-90fd-ba9143ef239e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:56.340635 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:56.369618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e9fc4-2d77-4ab0-bf67-60a272cb6325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:56.371195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e9fc4-2d77-4ab0-bf67-60a272cb6325 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:56.371626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e9fc4-2d77-4ab0-bf67-60a272cb6325 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:56.372062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e9fc4-2d77-4ab0-bf67-60a272cb6325 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:56.372971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e9fc4-2d77-4ab0-bf67-60a272cb6325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:56.373573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e9fc4-2d77-4ab0-bf67-60a272cb6325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:56.375858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e9fc4-2d77-4ab0-bf67-60a272cb6325 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:56.400117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 393/807] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:56.406584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e9fc4-2d77-4ab0-bf67-60a272cb6325 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:56.423935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:56.445411 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7a751-8ceb-4388-b2cb-ea94b961761b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:56.495487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983b173-6fc2-44a5-9700-7795fe372872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:56.496619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983b173-6fc2-44a5-9700-7795fe372872 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:56.497982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983b173-6fc2-44a5-9700-7795fe372872 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:56.499068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983b173-6fc2-44a5-9700-7795fe372872 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:56.500024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983b173-6fc2-44a5-9700-7795fe372872 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:56.501408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983b173-6fc2-44a5-9700-7795fe372872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:56.503868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983b173-6fc2-44a5-9700-7795fe372872 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:56.517472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 415/808] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jul 14 09:05:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:56.523172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983b173-6fc2-44a5-9700-7795fe372872 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:56.582001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e9fc4-2d77-4ab0-bf67-60a272cb6325 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:56.653171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3d5f7-bd57-4e2c-8694-924c7f626213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:56.653985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3d5f7-bd57-4e2c-8694-924c7f626213 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:56.654270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3d5f7-bd57-4e2c-8694-924c7f626213 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:56.654534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3d5f7-bd57-4e2c-8694-924c7f626213 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:56.671190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3d5f7-bd57-4e2c-8694-924c7f626213 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:56.673375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3d5f7-bd57-4e2c-8694-924c7f626213 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-bbb3d5f7-bd57-4e2c-8694-924c7f626213 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:56.705225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:56.706648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:56.707572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:56.707572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:56.707572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:56.707572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:56.707572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:56.707572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:56.707572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:56.707572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:56.717470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 394/809] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:56.720215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3d5f7-bd57-4e2c-8694-924c7f626213 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:56.753592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983b173-6fc2-44a5-9700-7795fe372872 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:56.763765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:56.795907 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a52bcc-bef7-440b-a6fd-d6b1a4e24ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:56.797207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a52bcc-bef7-440b-a6fd-d6b1a4e24ac0 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:56.797824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a52bcc-bef7-440b-a6fd-d6b1a4e24ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:56.798304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a52bcc-bef7-440b-a6fd-d6b1a4e24ac0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:56.799249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a52bcc-bef7-440b-a6fd-d6b1a4e24ac0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:56.801071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a52bcc-bef7-440b-a6fd-d6b1a4e24ac0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:56.812800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:56.827617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 416/810] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jul 14 09:05:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:05:56.829070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ad8a8-490a-40d5-90c0-cfb3887c2d21 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:56.829363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ad8a8-490a-40d5-90c0-cfb3887c2d21 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:56.829642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ad8a8-490a-40d5-90c0-cfb3887c2d21 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:56.835328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 417/811] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:56.836860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437ca4-716b-44db-9410-5a24e2b67ec5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:56.837155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437ca4-716b-44db-9410-5a24e2b67ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:56.837441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437ca4-716b-44db-9410-5a24e2b67ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:56.854758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7a437ca4-716b-44db-9410-5a24e2b67ec5 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:56.855785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3d5f7-bd57-4e2c-8694-924c7f626213 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:56.855972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7a437ca4-716b-44db-9410-5a24e2b67ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:56.938726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad920c-78b4-401d-ba19-b176677fa449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:56.941087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad920c-78b4-401d-ba19-b176677fa449 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:56.942283 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad920c-78b4-401d-ba19-b176677fa449 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:56.942794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad920c-78b4-401d-ba19-b176677fa449 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:56.945360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad920c-78b4-401d-ba19-b176677fa449 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:56.945981 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad920c-78b4-401d-ba19-b176677fa449 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:56.947688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad920c-78b4-401d-ba19-b176677fa449 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:56.975489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 418/812] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:05:56.977891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 395/813] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:56.987006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a437ca4-716b-44db-9410-5a24e2b67ec5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:56.999426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad920c-78b4-401d-ba19-b176677fa449 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:57.125620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad920c-78b4-401d-ba19-b176677fa449 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:57.137233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:57.148180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a437ca4-716b-44db-9410-5a24e2b67ec5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:57.156137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:57.168420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06f044-6016-4fa2-8524-8fa53b23e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:57.169245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06f044-6016-4fa2-8524-8fa53b23e20f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:57.169530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06f044-6016-4fa2-8524-8fa53b23e20f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:57.169804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06f044-6016-4fa2-8524-8fa53b23e20f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:57.186595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ec289-04d2-4b3f-b746-16484881a5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:57.187433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06f044-6016-4fa2-8524-8fa53b23e20f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:57.187987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ec289-04d2-4b3f-b746-16484881a5bb None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:57.188419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ec289-04d2-4b3f-b746-16484881a5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:57.188871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ec289-04d2-4b3f-b746-16484881a5bb None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/2dab40ef1f8d4f5abf10b92e99e04122/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:57.191563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ec289-04d2-4b3f-b746-16484881a5bb None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=2dab40ef1f8d4f5abf10b92e99e04122, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:57.193213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ec289-04d2-4b3f-b746-16484881a5bb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-4a06f044-6016-4fa2-8524-8fa53b23e20f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:57.195974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:57.197171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:57.198120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 396/814] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:57.205379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06f044-6016-4fa2-8524-8fa53b23e20f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:57.223774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 419/815] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:05:56 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/2dab40ef1f8d4f5abf10b92e99e04122/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:05:57.326469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06f044-6016-4fa2-8524-8fa53b23e20f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:57.364176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331007c5-f73b-499b-8840-779bc65ae285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:57.364892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331007c5-f73b-499b-8840-779bc65ae285 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:57.365174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331007c5-f73b-499b-8840-779bc65ae285 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:57.365455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331007c5-f73b-499b-8840-779bc65ae285 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:57.366223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331007c5-f73b-499b-8840-779bc65ae285 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:57.366543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331007c5-f73b-499b-8840-779bc65ae285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:57.367910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331007c5-f73b-499b-8840-779bc65ae285 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:57.378846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 397/816] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:05:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:57.385045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ec289-04d2-4b3f-b746-16484881a5bb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:57.420423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04223c-d2f3-435e-a91c-088031fd4c39 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:57.420736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04223c-d2f3-435e-a91c-088031fd4c39 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:57.421015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04223c-d2f3-435e-a91c-088031fd4c39 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:57.423787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 398/817] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:05:57.427874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a14d-6784-4c40-9b58-8c35c36e5994 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:57.428161 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a14d-6784-4c40-9b58-8c35c36e5994 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:57.428435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a14d-6784-4c40-9b58-8c35c36e5994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:57.456711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-48e3a14d-6784-4c40-9b58-8c35c36e5994 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:57.457915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-48e3a14d-6784-4c40-9b58-8c35c36e5994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:57.532709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:57.536594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ec289-04d2-4b3f-b746-16484881a5bb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:57.563786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 399/818] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:05:57.585390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc2c4-3856-4f04-b4f5-a0eaac80f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:57.586280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc2c4-3856-4f04-b4f5-a0eaac80f821 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:57.586558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc2c4-3856-4f04-b4f5-a0eaac80f821 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:57.586824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc2c4-3856-4f04-b4f5-a0eaac80f821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:57.603929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dc2c4-3856-4f04-b4f5-a0eaac80f821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:57.605477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dc2c4-3856-4f04-b4f5-a0eaac80f821 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-da6dc2c4-3856-4f04-b4f5-a0eaac80f821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:57.630097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:57.631032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:57.631915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:57.631915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:57.631915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:57.631915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:57.631915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 420/819] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:57.633784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3a14d-6784-4c40-9b58-8c35c36e5994 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:57.636770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc2c4-3856-4f04-b4f5-a0eaac80f821 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:57.641270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:57.745892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3a14d-6784-4c40-9b58-8c35c36e5994 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:57.784047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728528-7acf-4bc0-b0a6-73192ce64dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:57.785318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728528-7acf-4bc0-b0a6-73192ce64dbd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:57.785805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728528-7acf-4bc0-b0a6-73192ce64dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:57.786277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728528-7acf-4bc0-b0a6-73192ce64dbd None admin] PATH_INFO: `/v3/services/network` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:57.787186 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728528-7acf-4bc0-b0a6-73192ce64dbd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:57.788825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728528-7acf-4bc0-b0a6-73192ce64dbd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-ad728528-7acf-4bc0-b0a6-73192ce64dbd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:57.801582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:57.802672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:05:57.803510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:57.806414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 400/820] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:57 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:57.814641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728528-7acf-4bc0-b0a6-73192ce64dbd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:57.831097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc2c4-3856-4f04-b4f5-a0eaac80f821 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:57.893071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1affd-fb5a-4a41-a70c-78d61dedf0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:57.893993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1affd-fb5a-4a41-a70c-78d61dedf0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:57.894431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1affd-fb5a-4a41-a70c-78d61dedf0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:57.894844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1affd-fb5a-4a41-a70c-78d61dedf0e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:57.895707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1affd-fb5a-4a41-a70c-78d61dedf0e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:57.897607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1affd-fb5a-4a41-a70c-78d61dedf0e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:57.899129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1affd-fb5a-4a41-a70c-78d61dedf0e1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:57.901018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:57.914881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 421/821] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:57.919854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1affd-fb5a-4a41-a70c-78d61dedf0e1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:58.008820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728528-7acf-4bc0-b0a6-73192ce64dbd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:58.035287 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:58.082777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c89ce4-6f06-4acf-a60d-daedf9dc6145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:58.083756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89ce4-6f06-4acf-a60d-daedf9dc6145 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:58.084177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89ce4-6f06-4acf-a60d-daedf9dc6145 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:58.084616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89ce4-6f06-4acf-a60d-daedf9dc6145 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:58.085506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c89ce4-6f06-4acf-a60d-daedf9dc6145 None admin] RBAC: Adding query filter params (name=network) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:58.085950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c89ce4-6f06-4acf-a60d-daedf9dc6145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:58.088497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c89ce4-6f06-4acf-a60d-daedf9dc6145 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:58.105279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 401/822] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:05:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:58.110370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c89ce4-6f06-4acf-a60d-daedf9dc6145 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:58.112069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1affd-fb5a-4a41-a70c-78d61dedf0e1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:58.184165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568af3f6-902b-49c5-ad6c-2a27a08dafc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:58.185224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568af3f6-902b-49c5-ad6c-2a27a08dafc8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:58.185644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568af3f6-902b-49c5-ad6c-2a27a08dafc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:58.187031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568af3f6-902b-49c5-ad6c-2a27a08dafc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:58.199170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568af3f6-902b-49c5-ad6c-2a27a08dafc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:58.202340 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568af3f6-902b-49c5-ad6c-2a27a08dafc8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-568af3f6-902b-49c5-ad6c-2a27a08dafc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:05:58.228732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:58.229906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:58.231060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:58.231060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:58.231060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:05:58.231060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:05:58.231060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:05:58.231060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:05:58.231060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:05:58.231060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:05:58.231060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:05:58.231060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:58.241326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 422/823] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jul 14 09:05:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:58.244904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568af3f6-902b-49c5-ad6c-2a27a08dafc8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:58.334719 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c89ce4-6f06-4acf-a60d-daedf9dc6145 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:58.351739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568af3f6-902b-49c5-ad6c-2a27a08dafc8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:58.355349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:58.385059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:58.396237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed71844-9d93-4407-9195-39fe105be1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:58.397275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed71844-9d93-4407-9195-39fe105be1fd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:58.397879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed71844-9d93-4407-9195-39fe105be1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:58.399327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed71844-9d93-4407-9195-39fe105be1fd None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:58.400371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed71844-9d93-4407-9195-39fe105be1fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:58.401103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed71844-9d93-4407-9195-39fe105be1fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:58.403767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed71844-9d93-4407-9195-39fe105be1fd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:58.424875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 423/824] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jul 14 09:05:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:58.431016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed71844-9d93-4407-9195-39fe105be1fd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:58.445839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5eade-2b3a-4f74-8e44-c0ba5aa379ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:58.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5eade-2b3a-4f74-8e44-c0ba5aa379ff None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:58.447360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5eade-2b3a-4f74-8e44-c0ba5aa379ff None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:58.447826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5eade-2b3a-4f74-8e44-c0ba5aa379ff None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:58.448814 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5eade-2b3a-4f74-8e44-c0ba5aa379ff None admin] RBAC: Adding query filter params (type=network) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:58.449527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5eade-2b3a-4f74-8e44-c0ba5aa379ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:58.451690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5eade-2b3a-4f74-8e44-c0ba5aa379ff None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:58.469170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 402/825] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:05:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:58.484521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5eade-2b3a-4f74-8e44-c0ba5aa379ff None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:58.586067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed71844-9d93-4407-9195-39fe105be1fd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:58.622709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf00b8b-6bd0-4499-b4e6-d7f0e0f4c440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:58.623703 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf00b8b-6bd0-4499-b4e6-d7f0e0f4c440 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:58.623831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf00b8b-6bd0-4499-b4e6-d7f0e0f4c440 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:58.624103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf00b8b-6bd0-4499-b4e6-d7f0e0f4c440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:58.647177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5eade-2b3a-4f74-8e44-c0ba5aa379ff None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:58.680604 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:58.682038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97915b6d-33ea-46bf-bc42-564375ec8867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:58.682949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97915b6d-33ea-46bf-bc42-564375ec8867 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:58.683423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97915b6d-33ea-46bf-bc42-564375ec8867 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:58.683886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97915b6d-33ea-46bf-bc42-564375ec8867 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:58.684864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97915b6d-33ea-46bf-bc42-564375ec8867 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:58.686450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97915b6d-33ea-46bf-bc42-564375ec8867 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:58.698946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf00b8b-6bd0-4499-b4e6-d7f0e0f4c440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:58.700480 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf00b8b-6bd0-4499-b4e6-d7f0e0f4c440 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:58.716926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 403/826] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jul 14 09:05:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:05:58.718980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e1e1a-b1fe-4817-ba09-3ada1798155c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:58.719553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e1e1a-b1fe-4817-ba09-3ada1798155c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:58.720060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e1e1a-b1fe-4817-ba09-3ada1798155c None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:58.723328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 404/827] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:58.727879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cec3-9cb8-4a5f-bb18-c46109084739 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:58.728451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cec3-9cb8-4a5f-bb18-c46109084739 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:58.728940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cec3-9cb8-4a5f-bb18-c46109084739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:58.758168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5620cec3-9cb8-4a5f-bb18-c46109084739 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:58.760406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5620cec3-9cb8-4a5f-bb18-c46109084739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:58.801854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:58.822220 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 424/828] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:05:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:05:58.827720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf00b8b-6bd0-4499-b4e6-d7f0e0f4c440 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:58.942687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 405/829] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:05:58.945840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:58.960611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf00b8b-6bd0-4499-b4e6-d7f0e0f4c440 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:58.993774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620cec3-9cb8-4a5f-bb18-c46109084739 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:59.002698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89255d-7759-4008-9e87-83ae50dfb45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:59.003515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89255d-7759-4008-9e87-83ae50dfb45e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.003798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89255d-7759-4008-9e87-83ae50dfb45e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.004068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89255d-7759-4008-9e87-83ae50dfb45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.015622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89255d-7759-4008-9e87-83ae50dfb45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:59.017351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89255d-7759-4008-9e87-83ae50dfb45e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-8d89255d-7759-4008-9e87-83ae50dfb45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:59.036892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:59.037822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:59.038879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:59.038879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:59.038879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:59.038879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:59.038879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 425/830] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:59.045645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89255d-7759-4008-9e87-83ae50dfb45e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:59.131918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620cec3-9cb8-4a5f-bb18-c46109084739 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:59.178874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89255d-7759-4008-9e87-83ae50dfb45e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:59.179934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fe3af-8540-4052-ad14-282e9616f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:59.181032 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fe3af-8540-4052-ad14-282e9616f28e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.182213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fe3af-8540-4052-ad14-282e9616f28e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.182500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fe3af-8540-4052-ad14-282e9616f28e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.195282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fe3af-8540-4052-ad14-282e9616f28e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-0f5fe3af-8540-4052-ad14-282e9616f28e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:05:59.205004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:59.206054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:59.207114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 406/831] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:05:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:59.213941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fe3af-8540-4052-ad14-282e9616f28e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:59.223806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a3a92-6405-4922-8656-6362a7efdf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:59.224488 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3a92-6405-4922-8656-6362a7efdf02 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.224854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3a92-6405-4922-8656-6362a7efdf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.225131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3a92-6405-4922-8656-6362a7efdf02 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.225870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a3a92-6405-4922-8656-6362a7efdf02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:59.226179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a3a92-6405-4922-8656-6362a7efdf02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:59.227571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a3a92-6405-4922-8656-6362a7efdf02 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:59.229319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:59.234766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:59.247944 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 426/832] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:59.249191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a3a92-6405-4922-8656-6362a7efdf02 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:59.344634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fe3af-8540-4052-ad14-282e9616f28e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:59.376203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a3a92-6405-4922-8656-6362a7efdf02 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:59.385675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8092d3-48ad-4dd8-8a0a-7d54f226c52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:59.386565 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8092d3-48ad-4dd8-8a0a-7d54f226c52e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.387029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8092d3-48ad-4dd8-8a0a-7d54f226c52e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.387462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8092d3-48ad-4dd8-8a0a-7d54f226c52e None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.388364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8092d3-48ad-4dd8-8a0a-7d54f226c52e None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:59.388846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8092d3-48ad-4dd8-8a0a-7d54f226c52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:59.390440 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8092d3-48ad-4dd8-8a0a-7d54f226c52e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:59.399604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 407/833] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:05:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:05:59.401136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9715a-c8c1-4ef1-b21d-fe815e12a928 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.401571 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9715a-c8c1-4ef1-b21d-fe815e12a928 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.401991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9715a-c8c1-4ef1-b21d-fe815e12a928 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.403595 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 408/834] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:59.404769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9715a-c8c1-4ef1-b21d-fe815e12a928 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:59.414584 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751cef1-f6ea-4cca-89d7-4106d8018de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:59.415511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751cef1-f6ea-4cca-89d7-4106d8018de9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.415793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751cef1-f6ea-4cca-89d7-4106d8018de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.416069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751cef1-f6ea-4cca-89d7-4106d8018de9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.424079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751cef1-f6ea-4cca-89d7-4106d8018de9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:59.425582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751cef1-f6ea-4cca-89d7-4106d8018de9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-e751cef1-f6ea-4cca-89d7-4106d8018de9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:05:59.441470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:59.442539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 427/835] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74018bd4-0f21-41a9-a346-d2d5da08b3a0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.448443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74018bd4-0f21-41a9-a346-d2d5da08b3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.449230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74018bd4-0f21-41a9-a346-d2d5da08b3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.466455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-74018bd4-0f21-41a9-a346-d2d5da08b3a0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:59.467531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-74018bd4-0f21-41a9-a346-d2d5da08b3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:59.525973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:59.546716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 428/836] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:05:59.547428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74018bd4-0f21-41a9-a346-d2d5da08b3a0 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:59.627756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:59.651923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74018bd4-0f21-41a9-a346-d2d5da08b3a0 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:59.657057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9715a-c8c1-4ef1-b21d-fe815e12a928 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:59.691546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5fe04-190e-4e18-b322-09b0c7ef268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:59.692466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5fe04-190e-4e18-b322-09b0c7ef268c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.692775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5fe04-190e-4e18-b322-09b0c7ef268c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.693055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5fe04-190e-4e18-b322-09b0c7ef268c None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.693840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5fe04-190e-4e18-b322-09b0c7ef268c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:59.694143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5fe04-190e-4e18-b322-09b0c7ef268c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:59.694785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee5e0a-0b42-4020-9cce-1cc0f5802edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:59.695558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5fe04-190e-4e18-b322-09b0c7ef268c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:59.695658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee5e0a-0b42-4020-9cce-1cc0f5802edf None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.695845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee5e0a-0b42-4020-9cce-1cc0f5802edf None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.696113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee5e0a-0b42-4020-9cce-1cc0f5802edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.707242 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee5e0a-0b42-4020-9cce-1cc0f5802edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:59.712615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 429/837] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:59.712615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5fe04-190e-4e18-b322-09b0c7ef268c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:59.712843 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee5e0a-0b42-4020-9cce-1cc0f5802edf None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e7ee5e0a-0b42-4020-9cce-1cc0f5802edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:05:59.730881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:59.731986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:59.732962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:05:59.732962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:05:59.732962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:05:59.732962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:05:59.732962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 409/838] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:59.733557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111b83f-539e-45b8-93b1-96ec32987732 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.733671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111b83f-539e-45b8-93b1-96ec32987732 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.733942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111b83f-539e-45b8-93b1-96ec32987732 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.736693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 410/839] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:05:59.736693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111b83f-539e-45b8-93b1-96ec32987732 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:59.759208 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:59.813963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5fe04-190e-4e18-b322-09b0c7ef268c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:59.836741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111b83f-539e-45b8-93b1-96ec32987732 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:59.847059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf9090-a2c4-4f0c-a4ae-2acc67cded92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:59.847898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf9090-a2c4-4f0c-a4ae-2acc67cded92 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.848182 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf9090-a2c4-4f0c-a4ae-2acc67cded92 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.848455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf9090-a2c4-4f0c-a4ae-2acc67cded92 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.849171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf9090-a2c4-4f0c-a4ae-2acc67cded92 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:59.850556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf9090-a2c4-4f0c-a4ae-2acc67cded92 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-30cf9090-a2c4-4f0c-a4ae-2acc67cded92 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:05:59.862618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:05:59.863732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:05:59.864850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 430/840] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:05:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:05:59.865845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf9090-a2c4-4f0c-a4ae-2acc67cded92 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:59.866219 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:05:59.874809 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10c07d-2c8f-4af2-be95-8506abb6a08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:05:59.875469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10c07d-2c8f-4af2-be95-8506abb6a08c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.875753 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10c07d-2c8f-4af2-be95-8506abb6a08c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.876026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10c07d-2c8f-4af2-be95-8506abb6a08c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.876887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10c07d-2c8f-4af2-be95-8506abb6a08c None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=66f1d95bcc534f4e945fc2c5be046a5f) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:05:59.877200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10c07d-2c8f-4af2-be95-8506abb6a08c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:05:59.878624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10c07d-2c8f-4af2-be95-8506abb6a08c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:05:59.884591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 411/841] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:05:59 2022] GET /identity/v3/role_assignments?user.id=66f1d95bcc534f4e945fc2c5be046a5f&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:05:59.885783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37300a5-5761-4bad-883d-b6551233f209 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:05:59.886068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37300a5-5761-4bad-883d-b6551233f209 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:05:59.886346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37300a5-5761-4bad-883d-b6551233f209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:05:59.904359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e37300a5-5761-4bad-883d-b6551233f209 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:05:59.906055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e37300a5-5761-4bad-883d-b6551233f209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:05:59.983811 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf9090-a2c4-4f0c-a4ae-2acc67cded92 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:05:59.988708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 412/842] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:05:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:05:59.988708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37300a5-5761-4bad-883d-b6551233f209 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:05:59.998479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:00.027420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50fe9-8112-457f-a88c-7ad8e060b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:00.028100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50fe9-8112-457f-a88c-7ad8e060b543 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:00.028387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50fe9-8112-457f-a88c-7ad8e060b543 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:00.028683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50fe9-8112-457f-a88c-7ad8e060b543 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:00.029432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c50fe9-8112-457f-a88c-7ad8e060b543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:00.029739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c50fe9-8112-457f-a88c-7ad8e060b543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:00.032322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c50fe9-8112-457f-a88c-7ad8e060b543 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:00.047296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 431/843] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:00.048647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50fe9-8112-457f-a88c-7ad8e060b543 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:00.119925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37300a5-5761-4bad-883d-b6551233f209 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:00.148324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:00.162370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e6efb-902c-4eb6-9d0a-62675c9e2b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:00.163161 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e6efb-902c-4eb6-9d0a-62675c9e2b30 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:00.163449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e6efb-902c-4eb6-9d0a-62675c9e2b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:00.163723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e6efb-902c-4eb6-9d0a-62675c9e2b30 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:00.164026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50fe9-8112-457f-a88c-7ad8e060b543 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:00.164430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e6efb-902c-4eb6-9d0a-62675c9e2b30 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:00.164761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e6efb-902c-4eb6-9d0a-62675c9e2b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:00.167056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e6efb-902c-4eb6-9d0a-62675c9e2b30 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:00.173571 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 413/844] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:05:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:00.174864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e6efb-902c-4eb6-9d0a-62675c9e2b30 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:00.203061 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94078f-8f76-4d1a-9ec7-6709fc1249c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:00.203880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94078f-8f76-4d1a-9ec7-6709fc1249c0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:00.204159 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94078f-8f76-4d1a-9ec7-6709fc1249c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:00.204431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94078f-8f76-4d1a-9ec7-6709fc1249c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:00.215694 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94078f-8f76-4d1a-9ec7-6709fc1249c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-9a94078f-8f76-4d1a-9ec7-6709fc1249c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:00.223392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:00.224353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:00.225260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 432/845] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:00.225984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94078f-8f76-4d1a-9ec7-6709fc1249c0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:00.256583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:00.295589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e6efb-902c-4eb6-9d0a-62675c9e2b30 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:00.331869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a64d0-b715-4280-803f-e2b77ddc1468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:00.332765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a64d0-b715-4280-803f-e2b77ddc1468 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:00.333012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94078f-8f76-4d1a-9ec7-6709fc1249c0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:00.333117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a64d0-b715-4280-803f-e2b77ddc1468 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:00.333349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a64d0-b715-4280-803f-e2b77ddc1468 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:00.340878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a64d0-b715-4280-803f-e2b77ddc1468 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:00.342296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a64d0-b715-4280-803f-e2b77ddc1468 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a49a64d0-b715-4280-803f-e2b77ddc1468 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:06:00.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:00.359682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 414/846] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jul 14 09:06:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:00.360599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a64d0-b715-4280-803f-e2b77ddc1468 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:00.381574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555eec4-15a8-44d3-9fe6-902917292327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:00.382264 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555eec4-15a8-44d3-9fe6-902917292327 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:00.382540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555eec4-15a8-44d3-9fe6-902917292327 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:00.382818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555eec4-15a8-44d3-9fe6-902917292327 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:00.383540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555eec4-15a8-44d3-9fe6-902917292327 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:00.383850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555eec4-15a8-44d3-9fe6-902917292327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:00.385559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555eec4-15a8-44d3-9fe6-902917292327 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:00.390738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 433/847] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:06:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:00.391607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555eec4-15a8-44d3-9fe6-902917292327 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:00.430162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:00.500614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:00.511693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555eec4-15a8-44d3-9fe6-902917292327 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:00.516500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a64d0-b715-4280-803f-e2b77ddc1468 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:00.553914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feef039-a543-417d-8d07-f9ecf3e26255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:00.554943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feef039-a543-417d-8d07-f9ecf3e26255 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:00.554943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feef039-a543-417d-8d07-f9ecf3e26255 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:00.555123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feef039-a543-417d-8d07-f9ecf3e26255 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:00.556112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feef039-a543-417d-8d07-f9ecf3e26255 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:00.556288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feef039-a543-417d-8d07-f9ecf3e26255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:00.557776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feef039-a543-417d-8d07-f9ecf3e26255 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:00.566026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed68f0-2d8c-4e6c-ab96-9caafbcee892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:00.566935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed68f0-2d8c-4e6c-ab96-9caafbcee892 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:00.567327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed68f0-2d8c-4e6c-ab96-9caafbcee892 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:00.567604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed68f0-2d8c-4e6c-ab96-9caafbcee892 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:00.568354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed68f0-2d8c-4e6c-ab96-9caafbcee892 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:00.568673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed68f0-2d8c-4e6c-ab96-9caafbcee892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:00.570037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed68f0-2d8c-4e6c-ab96-9caafbcee892 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:00.578178 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 434/848] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jul 14 09:06:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:00.578873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 415/849] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:00.584422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feef039-a543-417d-8d07-f9ecf3e26255 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:00.584869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed68f0-2d8c-4e6c-ab96-9caafbcee892 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:00.687162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed68f0-2d8c-4e6c-ab96-9caafbcee892 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:00.714063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feef039-a543-417d-8d07-f9ecf3e26255 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:00.720849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00389f09-abba-4e1e-a777-976862877435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:00.721770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389f09-abba-4e1e-a777-976862877435 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:00.722170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389f09-abba-4e1e-a777-976862877435 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:00.722538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389f09-abba-4e1e-a777-976862877435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:00.734109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389f09-abba-4e1e-a777-976862877435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:00.735900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389f09-abba-4e1e-a777-976862877435 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-00389f09-abba-4e1e-a777-976862877435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:00.753912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:00.755056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:00.756207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:00.756207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:00.756207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:00.756207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:00.757030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4598f-6873-46af-80cd-cf46b13ee189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:00.762196 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 416/850] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:00.762335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4598f-6873-46af-80cd-cf46b13ee189 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:00.762416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:00.762490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4598f-6873-46af-80cd-cf46b13ee189 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:00.762490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4598f-6873-46af-80cd-cf46b13ee189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:00.763743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00389f09-abba-4e1e-a777-976862877435 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:00.785631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:00.848782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4598f-6873-46af-80cd-cf46b13ee189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:00.851258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4598f-6873-46af-80cd-cf46b13ee189 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:00.870158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00389f09-abba-4e1e-a777-976862877435 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:00.906210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db6ce0-83f9-4de3-844a-904adb96fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:00.907692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6ce0-83f9-4de3-844a-904adb96fcee None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:00.907974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6ce0-83f9-4de3-844a-904adb96fcee None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:00.908246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6ce0-83f9-4de3-844a-904adb96fcee None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:00.909004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db6ce0-83f9-4de3-844a-904adb96fcee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:00.909310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db6ce0-83f9-4de3-844a-904adb96fcee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:00.910670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db6ce0-83f9-4de3-844a-904adb96fcee None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:00.930248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 417/851] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:00.932458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db6ce0-83f9-4de3-844a-904adb96fcee None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:00.959519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:00.996302 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 435/852] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:01.001879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4598f-6873-46af-80cd-cf46b13ee189 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:01.063385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db6ce0-83f9-4de3-844a-904adb96fcee None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:01.074783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:01.108141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d19454-5d78-4ce9-9e32-a8eff9de3804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:01.108999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d19454-5d78-4ce9-9e32-a8eff9de3804 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:01.109282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d19454-5d78-4ce9-9e32-a8eff9de3804 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:01.109557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d19454-5d78-4ce9-9e32-a8eff9de3804 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:01.119595 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d19454-5d78-4ce9-9e32-a8eff9de3804 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:01.121260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d19454-5d78-4ce9-9e32-a8eff9de3804 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:01.141461 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4598f-6873-46af-80cd-cf46b13ee189 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-40d19454-5d78-4ce9-9e32-a8eff9de3804 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:06:01.141679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:01.142561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:01.143496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:01.143496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:01.143496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:06:01.143496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:06:01.143496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:06:01.143496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:06:01.143496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:06:01.143496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:06:01.143496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:06:01.143496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:01.147621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 418/853] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:06:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:01.149612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d19454-5d78-4ce9-9e32-a8eff9de3804 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:01.192128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed36d4d-2604-4714-96d3-8011c9ff8745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:01.193332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36d4d-2604-4714-96d3-8011c9ff8745 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:01.193833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36d4d-2604-4714-96d3-8011c9ff8745 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:01.194317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36d4d-2604-4714-96d3-8011c9ff8745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:01.209762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed36d4d-2604-4714-96d3-8011c9ff8745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:01.211469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed36d4d-2604-4714-96d3-8011c9ff8745 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-aed36d4d-2604-4714-96d3-8011c9ff8745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:01.237228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:01.238145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:01.239062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:01.239062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:01.239062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:01.239062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:01.241760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 436/854] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:01.247472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed36d4d-2604-4714-96d3-8011c9ff8745 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:01.251001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:01.274382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d19454-5d78-4ce9-9e32-a8eff9de3804 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:01.316099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b314e0c-59d6-4ad5-9411-c5855baac34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:01.316838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314e0c-59d6-4ad5-9411-c5855baac34a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:01.317380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314e0c-59d6-4ad5-9411-c5855baac34a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:01.317658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314e0c-59d6-4ad5-9411-c5855baac34a None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:01.318502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b314e0c-59d6-4ad5-9411-c5855baac34a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:01.318808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b314e0c-59d6-4ad5-9411-c5855baac34a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:01.320230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b314e0c-59d6-4ad5-9411-c5855baac34a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:01.346422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 419/855] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jul 14 09:06:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:01.347300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b314e0c-59d6-4ad5-9411-c5855baac34a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:01.386228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed36d4d-2604-4714-96d3-8011c9ff8745 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:01.387971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:01.429683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44009776-55d6-4af4-981e-28d035d40351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:01.430356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44009776-55d6-4af4-981e-28d035d40351 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:01.430637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44009776-55d6-4af4-981e-28d035d40351 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:01.430909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44009776-55d6-4af4-981e-28d035d40351 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:01.431629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44009776-55d6-4af4-981e-28d035d40351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:01.431932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44009776-55d6-4af4-981e-28d035d40351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:01.433359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44009776-55d6-4af4-981e-28d035d40351 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:01.449237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 437/856] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:01.450999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44009776-55d6-4af4-981e-28d035d40351 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:01.475600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b314e0c-59d6-4ad5-9411-c5855baac34a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:01.517886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c14f1-3ef3-4f0c-b9ff-f4bc4eec11e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:01.518876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c14f1-3ef3-4f0c-b9ff-f4bc4eec11e2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:01.519394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c14f1-3ef3-4f0c-b9ff-f4bc4eec11e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:01.519876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c14f1-3ef3-4f0c-b9ff-f4bc4eec11e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:01.532048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:01.586441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44009776-55d6-4af4-981e-28d035d40351 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:01.598536 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c14f1-3ef3-4f0c-b9ff-f4bc4eec11e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:01.600336 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c14f1-3ef3-4f0c-b9ff-f4bc4eec11e2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:01.630752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53560d2-7287-4bfc-8b06-faac8499568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:01.631558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53560d2-7287-4bfc-8b06-faac8499568c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:01.631838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53560d2-7287-4bfc-8b06-faac8499568c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:01.632107 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53560d2-7287-4bfc-8b06-faac8499568c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:01.641446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53560d2-7287-4bfc-8b06-faac8499568c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:01.642886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53560d2-7287-4bfc-8b06-faac8499568c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-f53560d2-7287-4bfc-8b06-faac8499568c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:06:01.663992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:01.665014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:01.665930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:06:01.665930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:06:01.665930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:06:01.665930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:06:01.665930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:06:01.665930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:06:01.665930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:01.665930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:01.668807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 438/857] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:01.671409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53560d2-7287-4bfc-8b06-faac8499568c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:01.703434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:01.721278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 420/858] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:01.723696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c14f1-3ef3-4f0c-b9ff-f4bc4eec11e2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:01.767286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:01.833564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c14f1-3ef3-4f0c-b9ff-f4bc4eec11e2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:01.873337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e900f-d3b7-47b0-bca9-02f6267eefa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:01.874808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e900f-d3b7-47b0-bca9-02f6267eefa2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:01.875115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e900f-d3b7-47b0-bca9-02f6267eefa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:01.875392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e900f-d3b7-47b0-bca9-02f6267eefa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:01.890419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e900f-d3b7-47b0-bca9-02f6267eefa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:01.892672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e900f-d3b7-47b0-bca9-02f6267eefa2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-097e900f-d3b7-47b0-bca9-02f6267eefa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:01.915835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:01.916821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:01.917877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:01.917877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:01.917877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:01.917877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:01.924519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 421/859] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:01.925605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e900f-d3b7-47b0-bca9-02f6267eefa2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:01.928380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53560d2-7287-4bfc-8b06-faac8499568c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:01.966418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d850f51-2792-4cfb-82d3-859c12f1868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:01.968058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d850f51-2792-4cfb-82d3-859c12f1868d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:01.968441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d850f51-2792-4cfb-82d3-859c12f1868d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:01.968857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d850f51-2792-4cfb-82d3-859c12f1868d None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:01.969829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d850f51-2792-4cfb-82d3-859c12f1868d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:01.970233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d850f51-2792-4cfb-82d3-859c12f1868d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:01.971821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d850f51-2792-4cfb-82d3-859c12f1868d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:01.989939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 439/860] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:01.989939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89674a7-7f3b-4d2b-b7a7-480cd3b85637 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:01.989939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89674a7-7f3b-4d2b-b7a7-480cd3b85637 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:01.989939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89674a7-7f3b-4d2b-b7a7-480cd3b85637 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:01.989939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 440/861] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:01.991327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89674a7-7f3b-4d2b-b7a7-480cd3b85637 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:02.033980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:02.046419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e900f-d3b7-47b0-bca9-02f6267eefa2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:02.080508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:02.090485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842529c-8ce2-48ea-a911-04784d4a23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:02.091185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842529c-8ce2-48ea-a911-04784d4a23e3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.091439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842529c-8ce2-48ea-a911-04784d4a23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.091716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842529c-8ce2-48ea-a911-04784d4a23e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.092701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842529c-8ce2-48ea-a911-04784d4a23e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:02.092969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842529c-8ce2-48ea-a911-04784d4a23e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:02.094478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842529c-8ce2-48ea-a911-04784d4a23e3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:02.105124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89674a7-7f3b-4d2b-b7a7-480cd3b85637 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:02.111598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 422/862] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:02.111598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89b235-e2ca-4f88-b072-6e265abb43b3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.111598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89b235-e2ca-4f88-b072-6e265abb43b3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.111598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89b235-e2ca-4f88-b072-6e265abb43b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.129227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-cf89b235-e2ca-4f88-b072-6e265abb43b3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:02.131094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cf89b235-e2ca-4f88-b072-6e265abb43b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:02.147638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afd2e-399d-45d2-b7df-936e7549064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:02.148410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afd2e-399d-45d2-b7df-936e7549064c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.148637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afd2e-399d-45d2-b7df-936e7549064c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.148949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afd2e-399d-45d2-b7df-936e7549064c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.149780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850afd2e-399d-45d2-b7df-936e7549064c None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=6c7099627b964e91870043f512b8b7dc) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:02.150181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850afd2e-399d-45d2-b7df-936e7549064c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:02.151512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850afd2e-399d-45d2-b7df-936e7549064c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:02.168883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 441/863] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:01 2022] GET /identity/v3/role_assignments?user.id=6c7099627b964e91870043f512b8b7dc&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:02.168883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afd2e-399d-45d2-b7df-936e7549064c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:02.219640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 423/864] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:02.244105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89b235-e2ca-4f88-b072-6e265abb43b3 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:02.292062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afd2e-399d-45d2-b7df-936e7549064c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:02.339779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:02.342464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8b4fc-7871-44d6-b8c9-09fe6b80f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:02.343467 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b4fc-7871-44d6-b8c9-09fe6b80f7ee None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.343749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b4fc-7871-44d6-b8c9-09fe6b80f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.344020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b4fc-7871-44d6-b8c9-09fe6b80f7ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.353470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8b4fc-7871-44d6-b8c9-09fe6b80f7ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:02.355785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8b4fc-7871-44d6-b8c9-09fe6b80f7ee None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:02.371284 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89b235-e2ca-4f88-b072-6e265abb43b3 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-6bd8b4fc-7871-44d6-b8c9-09fe6b80f7ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:06:02.374541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:02.375445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:02.376356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:06:02.376356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:06:02.376356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:06:02.376356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:06:02.376356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:06:02.376356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:06:02.376356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:02.376356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:02.376356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 442/865] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:02.384237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8b4fc-7871-44d6-b8c9-09fe6b80f7ee None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:02.396111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:02.417201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebdbd8-8229-4bf8-bdc4-499eb748829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:02.419172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebdbd8-8229-4bf8-bdc4-499eb748829a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.419172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebdbd8-8229-4bf8-bdc4-499eb748829a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.419172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebdbd8-8229-4bf8-bdc4-499eb748829a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.419172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebdbd8-8229-4bf8-bdc4-499eb748829a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:02.420694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebdbd8-8229-4bf8-bdc4-499eb748829a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-56ebdbd8-8229-4bf8-bdc4-499eb748829a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:02.434070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:02.435079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:02.436012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 424/866] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Jul 14 09:06:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:02.443715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f8b48-3b18-41e8-a936-922563753465 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.444004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f8b48-3b18-41e8-a936-922563753465 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.444278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f8b48-3b18-41e8-a936-922563753465 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.446241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 425/867] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:02.446976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f8b48-3b18-41e8-a936-922563753465 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:02.510241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8b4fc-7871-44d6-b8c9-09fe6b80f7ee None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:02.546421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4602cf-821d-48cb-97f0-f1a5525b2b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:02.547702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4602cf-821d-48cb-97f0-f1a5525b2b41 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.548241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4602cf-821d-48cb-97f0-f1a5525b2b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.548724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4602cf-821d-48cb-97f0-f1a5525b2b41 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.549661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4602cf-821d-48cb-97f0-f1a5525b2b41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:02.550125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4602cf-821d-48cb-97f0-f1a5525b2b41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:02.551583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4602cf-821d-48cb-97f0-f1a5525b2b41 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:02.568733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 443/868] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:02.568733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa631d-2021-494c-a95a-ba634024ef11 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.568733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa631d-2021-494c-a95a-ba634024ef11 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.568733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa631d-2021-494c-a95a-ba634024ef11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.572513 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f8b48-3b18-41e8-a936-922563753465 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:02.585151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0daa631d-2021-494c-a95a-ba634024ef11 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:02.586928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0daa631d-2021-494c-a95a-ba634024ef11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:02.607476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda4baa-6b94-4843-ac5b-0bed03eb8cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:02.608259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda4baa-6b94-4843-ac5b-0bed03eb8cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.608538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda4baa-6b94-4843-ac5b-0bed03eb8cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.608840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda4baa-6b94-4843-ac5b-0bed03eb8cb3 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.609668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda4baa-6b94-4843-ac5b-0bed03eb8cb3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:02.609980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda4baa-6b94-4843-ac5b-0bed03eb8cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:02.611329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda4baa-6b94-4843-ac5b-0bed03eb8cb3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:02.621700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 426/869] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:02.622432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda4baa-6b94-4843-ac5b-0bed03eb8cb3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:02.636448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:02.656868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:02.665941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 444/870] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:02.666751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa631d-2021-494c-a95a-ba634024ef11 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:02.741877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda4baa-6b94-4843-ac5b-0bed03eb8cb3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:02.769418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa631d-2021-494c-a95a-ba634024ef11 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:02.780602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633591b-1294-4b45-bdc8-87e2831062e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:02.781388 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633591b-1294-4b45-bdc8-87e2831062e0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.781734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633591b-1294-4b45-bdc8-87e2831062e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.782010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633591b-1294-4b45-bdc8-87e2831062e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.782887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633591b-1294-4b45-bdc8-87e2831062e0 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=2dab40ef1f8d4f5abf10b92e99e04122) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:02.783197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633591b-1294-4b45-bdc8-87e2831062e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:02.784616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633591b-1294-4b45-bdc8-87e2831062e0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:02.790783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 427/871] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:02 2022] GET /identity/v3/role_assignments?user.id=2dab40ef1f8d4f5abf10b92e99e04122&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:02.791351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633591b-1294-4b45-bdc8-87e2831062e0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:02.823893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e926df-1f29-44c3-85e5-3ca59417c006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:02.824538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e926df-1f29-44c3-85e5-3ca59417c006 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.824872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e926df-1f29-44c3-85e5-3ca59417c006 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.825144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e926df-1f29-44c3-85e5-3ca59417c006 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.826162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e926df-1f29-44c3-85e5-3ca59417c006 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:02.826524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e926df-1f29-44c3-85e5-3ca59417c006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:02.827980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e926df-1f29-44c3-85e5-3ca59417c006 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:02.841277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 445/872] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:02.884160 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:02.921401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633591b-1294-4b45-bdc8-87e2831062e0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:02.962188 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb197c-da4d-44df-9dfb-2b62b8d2a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:02.963378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb197c-da4d-44df-9dfb-2b62b8d2a5e6 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:02.963860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb197c-da4d-44df-9dfb-2b62b8d2a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:02.964335 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb197c-da4d-44df-9dfb-2b62b8d2a5e6 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:02.965334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb197c-da4d-44df-9dfb-2b62b8d2a5e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:02.967143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb197c-da4d-44df-9dfb-2b62b8d2a5e6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:02.987592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 428/873] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:06:02 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:04.381280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab4cb-7a19-4756-a8b7-ab92a6047a01 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:04.382114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab4cb-7a19-4756-a8b7-ab92a6047a01 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:04.382588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab4cb-7a19-4756-a8b7-ab92a6047a01 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:04.384430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 446/874] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:04.390425 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dcc33-a30b-45d5-bfca-5e86a2941b05 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:04.391252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dcc33-a30b-45d5-bfca-5e86a2941b05 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:04.391743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dcc33-a30b-45d5-bfca-5e86a2941b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:04.409979 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-480dcc33-a30b-45d5-bfca-5e86a2941b05 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:04.411493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-480dcc33-a30b-45d5-bfca-5e86a2941b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:04.491538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 429/875] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:06:04.515990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ab4cb-7a19-4756-a8b7-ab92a6047a01 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:04.587177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:04.631615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ab4cb-7a19-4756-a8b7-ab92a6047a01 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:04.671817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b5f5-0488-438c-8b21-6fb572743114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:04.672647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b5f5-0488-438c-8b21-6fb572743114 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:04.672966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b5f5-0488-438c-8b21-6fb572743114 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:04.673376 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b5f5-0488-438c-8b21-6fb572743114 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:04.684262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1b5f5-0488-438c-8b21-6fb572743114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-37d1b5f5-0488-438c-8b21-6fb572743114 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:04.692517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:04.693520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:04.694391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 447/876] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jul 14 09:06:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:04.702387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dcc33-a30b-45d5-bfca-5e86a2941b05 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:04.767279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:04.812766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dcc33-a30b-45d5-bfca-5e86a2941b05 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:04.852546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e503a8-a535-43ae-ac2a-8c5bd4b0eceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:04.853262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e503a8-a535-43ae-ac2a-8c5bd4b0eceb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:04.853546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e503a8-a535-43ae-ac2a-8c5bd4b0eceb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:04.853822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e503a8-a535-43ae-ac2a-8c5bd4b0eceb None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:04.854587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e503a8-a535-43ae-ac2a-8c5bd4b0eceb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:04.854892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e503a8-a535-43ae-ac2a-8c5bd4b0eceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:04.856265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e503a8-a535-43ae-ac2a-8c5bd4b0eceb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:04.865200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 430/877] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jul 14 09:06:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:04.867259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99545-9a6e-47db-83f8-b19df185eb4a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:04.867552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99545-9a6e-47db-83f8-b19df185eb4a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:04.867830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99545-9a6e-47db-83f8-b19df185eb4a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:04.869342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 448/878] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:06:04.871874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e503a8-a535-43ae-ac2a-8c5bd4b0eceb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:04.876503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3452430-daac-4580-8a5b-cbb7a6cd0afe None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:04.876503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3452430-daac-4580-8a5b-cbb7a6cd0afe None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:04.876503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3452430-daac-4580-8a5b-cbb7a6cd0afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:04.895852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d3452430-daac-4580-8a5b-cbb7a6cd0afe None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:04.898027 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d3452430-daac-4580-8a5b-cbb7a6cd0afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:04.982869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 449/879] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:04.984373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a08c-38d2-45f9-aff0-d367826b4f93 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:04.984686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a08c-38d2-45f9-aff0-d367826b4f93 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:04.985262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a08c-38d2-45f9-aff0-d367826b4f93 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:04.988955 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 450/880] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:04.992188 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bff8c0-c77a-4d5e-8371-824f644e95d6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:04.992681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bff8c0-c77a-4d5e-8371-824f644e95d6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:04.993131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bff8c0-c77a-4d5e-8371-824f644e95d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.001481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e503a8-a535-43ae-ac2a-8c5bd4b0eceb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:05.011019 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a3bff8c0-c77a-4d5e-8371-824f644e95d6 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:05.012218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a3bff8c0-c77a-4d5e-8371-824f644e95d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:05.022590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:05.037281 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bc11b-d17d-420c-b6e2-068d4336b409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:05.038093 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc11b-d17d-420c-b6e2-068d4336b409 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.038376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc11b-d17d-420c-b6e2-068d4336b409 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.038651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc11b-d17d-420c-b6e2-068d4336b409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.050136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bc11b-d17d-420c-b6e2-068d4336b409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:05.051611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bc11b-d17d-420c-b6e2-068d4336b409 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:05.067280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-005bc11b-d17d-420c-b6e2-068d4336b409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:05.072897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:05.073824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:05.080452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:05.080452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:05.080452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:05.080452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:05.080452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 431/881] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:05.080452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bc11b-d17d-420c-b6e2-068d4336b409 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:05.096629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 451/882] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:05.097351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bff8c0-c77a-4d5e-8371-824f644e95d6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:05.193164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bc11b-d17d-420c-b6e2-068d4336b409 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:05.200006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bff8c0-c77a-4d5e-8371-824f644e95d6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:05.226105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a770f-1855-4dd3-b228-5704dcdf191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:05.226769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a770f-1855-4dd3-b228-5704dcdf191d None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.227053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a770f-1855-4dd3-b228-5704dcdf191d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.227325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a770f-1855-4dd3-b228-5704dcdf191d None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.228048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a770f-1855-4dd3-b228-5704dcdf191d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:05.229446 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a770f-1855-4dd3-b228-5704dcdf191d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:05.233943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22aced5-8d66-469e-92e8-5d18ea3f5778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:05.234711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aced5-8d66-469e-92e8-5d18ea3f5778 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.234990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aced5-8d66-469e-92e8-5d18ea3f5778 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.235273 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aced5-8d66-469e-92e8-5d18ea3f5778 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.235983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22aced5-8d66-469e-92e8-5d18ea3f5778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:05.236289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22aced5-8d66-469e-92e8-5d18ea3f5778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:05.237712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22aced5-8d66-469e-92e8-5d18ea3f5778 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:05.245040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 432/883] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:06:05 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:05.245874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a770f-1855-4dd3-b228-5704dcdf191d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:05.261630 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 452/884] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:05.263232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8017c38-deb9-4249-8aa0-0e973e19d7a1 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.263637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8017c38-deb9-4249-8aa0-0e973e19d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.263913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8017c38-deb9-4249-8aa0-0e973e19d7a1 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.265375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 453/885] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:05.269790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8017c38-deb9-4249-8aa0-0e973e19d7a1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:05.283576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:05.323791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:05.376157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a770f-1855-4dd3-b228-5704dcdf191d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:05.402282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8017c38-deb9-4249-8aa0-0e973e19d7a1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:05.417260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768af28d-8d4f-45c3-a173-74cb96c64146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:05.418085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af28d-8d4f-45c3-a173-74cb96c64146 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.418361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af28d-8d4f-45c3-a173-74cb96c64146 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.418625 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768af28d-8d4f-45c3-a173-74cb96c64146 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.419382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768af28d-8d4f-45c3-a173-74cb96c64146 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:05.420832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768af28d-8d4f-45c3-a173-74cb96c64146 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-768af28d-8d4f-45c3-a173-74cb96c64146 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:05.434636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:05.435743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:05.436637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 433/886] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:05.437619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a1ce-c8d2-4645-99b3-d50c22ae1fa7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.437619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a1ce-c8d2-4645-99b3-d50c22ae1fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.438040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a1ce-c8d2-4645-99b3-d50c22ae1fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.444537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4b0b3-8175-410d-8081-5710ef3582b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:05.445422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4b0b3-8175-410d-8081-5710ef3582b0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.445711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4b0b3-8175-410d-8081-5710ef3582b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.445989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4b0b3-8175-410d-8081-5710ef3582b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.455346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4b0b3-8175-410d-8081-5710ef3582b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:05.455790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7b02a1ce-c8d2-4645-99b3-d50c22ae1fa7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:05.457021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4b0b3-8175-410d-8081-5710ef3582b0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:05.457141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7b02a1ce-c8d2-4645-99b3-d50c22ae1fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b9f4b0b3-8175-410d-8081-5710ef3582b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:06:05.473747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:05.475119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 454/887] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jul 14 09:06:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:05.476085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4b0b3-8175-410d-8081-5710ef3582b0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:05.536723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 434/888] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:05.536723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02a1ce-c8d2-4645-99b3-d50c22ae1fa7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:05.573268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:05.581803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:05.584999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4b0b3-8175-410d-8081-5710ef3582b0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:05.624978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79e56-4cff-41c8-a937-622365d5986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:05.625739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79e56-4cff-41c8-a937-622365d5986f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.626028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79e56-4cff-41c8-a937-622365d5986f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.626296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79e56-4cff-41c8-a937-622365d5986f None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.626983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79e56-4cff-41c8-a937-622365d5986f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:05.627297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79e56-4cff-41c8-a937-622365d5986f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:05.629477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79e56-4cff-41c8-a937-622365d5986f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:05.640990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 455/889] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jul 14 09:06:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:05.641769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79e56-4cff-41c8-a937-622365d5986f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:05.657534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02a1ce-c8d2-4645-99b3-d50c22ae1fa7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:05.696919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c0d9-424a-4e51-b602-ee7405359a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:05.697742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c0d9-424a-4e51-b602-ee7405359a09 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.698407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c0d9-424a-4e51-b602-ee7405359a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.698693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c0d9-424a-4e51-b602-ee7405359a09 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.699535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c0d9-424a-4e51-b602-ee7405359a09 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:05.699838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c0d9-424a-4e51-b602-ee7405359a09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:05.702123 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c0d9-424a-4e51-b602-ee7405359a09 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:05.723127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 435/890] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jul 14 09:06:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:05.723987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c0d9-424a-4e51-b602-ee7405359a09 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:05.751684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79e56-4cff-41c8-a937-622365d5986f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:05.788257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d049a7-f888-427e-9c88-65975fe96314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:05.789110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d049a7-f888-427e-9c88-65975fe96314 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.789388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d049a7-f888-427e-9c88-65975fe96314 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.789663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d049a7-f888-427e-9c88-65975fe96314 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.790324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d049a7-f888-427e-9c88-65975fe96314 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:05.791677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d049a7-f888-427e-9c88-65975fe96314 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-96d049a7-f888-427e-9c88-65975fe96314 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:05.804153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:05.805388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:05.806252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 456/891] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:06:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:05.807058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d049a7-f888-427e-9c88-65975fe96314 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:05.815456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:05.839172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:05.840956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c0d9-424a-4e51-b602-ee7405359a09 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:05.878798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4982-06c5-4a4e-b7b5-2b1edd85a526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:05.879482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4982-06c5-4a4e-b7b5-2b1edd85a526 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.879765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4982-06c5-4a4e-b7b5-2b1edd85a526 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.880040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4982-06c5-4a4e-b7b5-2b1edd85a526 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:05.880783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de4982-06c5-4a4e-b7b5-2b1edd85a526 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:05.881086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de4982-06c5-4a4e-b7b5-2b1edd85a526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:05.882445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de4982-06c5-4a4e-b7b5-2b1edd85a526 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:05.896701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 436/892] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jul 14 09:06:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:05.896701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4982-06c5-4a4e-b7b5-2b1edd85a526 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:05.923191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d049a7-f888-427e-9c88-65975fe96314 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:05.971695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8f6e0-f3c9-4e94-8723-5cd67448ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:05.972461 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f6e0-f3c9-4e94-8723-5cd67448ffc9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:05.972843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f6e0-f3c9-4e94-8723-5cd67448ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:05.973179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f6e0-f3c9-4e94-8723-5cd67448ffc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:06.030468 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4982-06c5-4a4e-b7b5-2b1edd85a526 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:06.070651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353e6c-919f-49e1-b9f8-9b458f07a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:06.071326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353e6c-919f-49e1-b9f8-9b458f07a464 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:06.071605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353e6c-919f-49e1-b9f8-9b458f07a464 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:06.071875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353e6c-919f-49e1-b9f8-9b458f07a464 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:06.071972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8f6e0-f3c9-4e94-8723-5cd67448ffc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:06.073071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5353e6c-919f-49e1-b9f8-9b458f07a464 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:06.073375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5353e6c-919f-49e1-b9f8-9b458f07a464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:06.073709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8f6e0-f3c9-4e94-8723-5cd67448ffc9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:06.074718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5353e6c-919f-49e1-b9f8-9b458f07a464 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:06.084763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 437/893] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:06:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:06.087874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353e6c-919f-49e1-b9f8-9b458f07a464 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:06.101530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:06.110233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:06.193384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 457/894] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:05 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:06.194872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8f6e0-f3c9-4e94-8723-5cd67448ffc9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:06.199537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353e6c-919f-49e1-b9f8-9b458f07a464 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:06.236616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765fb39-6fd4-4ff7-be7e-b4b67d8e16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:06.237267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765fb39-6fd4-4ff7-be7e-b4b67d8e16bd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:06.237563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765fb39-6fd4-4ff7-be7e-b4b67d8e16bd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:06.237847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765fb39-6fd4-4ff7-be7e-b4b67d8e16bd None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:06.238565 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765fb39-6fd4-4ff7-be7e-b4b67d8e16bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:06.238871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765fb39-6fd4-4ff7-be7e-b4b67d8e16bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:06.240246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765fb39-6fd4-4ff7-be7e-b4b67d8e16bd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:06.245959 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 438/895] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:06:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:06.253382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765fb39-6fd4-4ff7-be7e-b4b67d8e16bd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:06.310961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8f6e0-f3c9-4e94-8723-5cd67448ffc9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:06.338339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:06.339924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:06.349471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ba18-e304-4796-9211-2b336db50b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:06.350353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ba18-e304-4796-9211-2b336db50b10 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:06.350968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ba18-e304-4796-9211-2b336db50b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:06.351078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ba18-e304-4796-9211-2b336db50b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:06.362758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904ba18-e304-4796-9211-2b336db50b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:06.364205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904ba18-e304-4796-9211-2b336db50b10 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:06.379566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765fb39-6fd4-4ff7-be7e-b4b67d8e16bd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-7904ba18-e304-4796-9211-2b336db50b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:06.384727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:06.385695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:06.386693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:06.386693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:06.386693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:06.386693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:06.390489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 458/896] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:06.391886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ba18-e304-4796-9211-2b336db50b10 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:06.422165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e72c8-d886-47ea-a95c-bd949c516243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:06.423596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e72c8-d886-47ea-a95c-bd949c516243 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:06.424062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e72c8-d886-47ea-a95c-bd949c516243 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:06.424513 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e72c8-d886-47ea-a95c-bd949c516243 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:06.425609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e72c8-d886-47ea-a95c-bd949c516243 None admin] RBAC: Adding query filter params (interface=public, service_id=99fec1e7ba7141029b9c9a457a7eb4c0, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:06.426067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e72c8-d886-47ea-a95c-bd949c516243 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:06.427644 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e72c8-d886-47ea-a95c-bd949c516243 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:06.433876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 439/897] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jul 14 09:06:06 2022] GET /identity/v3/endpoints?service_id=99fec1e7ba7141029b9c9a457a7eb4c0&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:06.441528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e72c8-d886-47ea-a95c-bd949c516243 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:06.506838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ba18-e304-4796-9211-2b336db50b10 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:06.544130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e72c8-d886-47ea-a95c-bd949c516243 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:06.545976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325cff7-ef2d-4022-b2d2-4500cc016a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:06.547016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325cff7-ef2d-4022-b2d2-4500cc016a7c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:06.547512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325cff7-ef2d-4022-b2d2-4500cc016a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:06.548015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325cff7-ef2d-4022-b2d2-4500cc016a7c None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:06.548989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325cff7-ef2d-4022-b2d2-4500cc016a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:06.549509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325cff7-ef2d-4022-b2d2-4500cc016a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:06.551056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325cff7-ef2d-4022-b2d2-4500cc016a7c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:06.568794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 459/898] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:06.570690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325cff7-ef2d-4022-b2d2-4500cc016a7c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:06.579610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadceaaf-2297-4a15-9022-c1582d0e6576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:06.580297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadceaaf-2297-4a15-9022-c1582d0e6576 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:06.580562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadceaaf-2297-4a15-9022-c1582d0e6576 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:06.580865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadceaaf-2297-4a15-9022-c1582d0e6576 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:06.581552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadceaaf-2297-4a15-9022-c1582d0e6576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:06.582924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadceaaf-2297-4a15-9022-c1582d0e6576 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:06.584911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:06.589827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 440/899] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jul 14 09:06:06 2022] GET /identity/v3/services => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:06:06.627875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:06.693085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325cff7-ef2d-4022-b2d2-4500cc016a7c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:06.728628 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d50090-13bc-48f3-9722-48b8e67bba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:06.729487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d50090-13bc-48f3-9722-48b8e67bba2e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:06.729771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d50090-13bc-48f3-9722-48b8e67bba2e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:06.730044 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d50090-13bc-48f3-9722-48b8e67bba2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:06.738109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d50090-13bc-48f3-9722-48b8e67bba2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:06.739572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d50090-13bc-48f3-9722-48b8e67bba2e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-09d50090-13bc-48f3-9722-48b8e67bba2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:06:06.754928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:06.755910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:06.757270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:06:06.757270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:06:06.757270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:06:06.757270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:06:06.757270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:06:06.757270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:06:06.757270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:06.757270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:06.757270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 460/900] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:06.764014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadceaaf-2297-4a15-9022-c1582d0e6576 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:06.875196 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadceaaf-2297-4a15-9022-c1582d0e6576 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:06.912092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1077b98-780f-49e8-9ae7-c400f2640865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:06.913155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1077b98-780f-49e8-9ae7-c400f2640865 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:06.913634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1077b98-780f-49e8-9ae7-c400f2640865 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:06.914097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1077b98-780f-49e8-9ae7-c400f2640865 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:06.915081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1077b98-780f-49e8-9ae7-c400f2640865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:06.915633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1077b98-780f-49e8-9ae7-c400f2640865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:06.917333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1077b98-780f-49e8-9ae7-c400f2640865 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:06.935091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 441/901] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:06:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:06.937769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d50090-13bc-48f3-9722-48b8e67bba2e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:07.047483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:07.050594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d50090-13bc-48f3-9722-48b8e67bba2e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:07.089920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92638a-fd7d-4dea-b5db-eb028a48aa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:07.090581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92638a-fd7d-4dea-b5db-eb028a48aa24 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:07.091062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92638a-fd7d-4dea-b5db-eb028a48aa24 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:07.091845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92638a-fd7d-4dea-b5db-eb028a48aa24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:07.092717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92638a-fd7d-4dea-b5db-eb028a48aa24 None admin] RBAC: Adding query filter params (role.id=234ada2bd8934cae8ffecb7e13fc8a96, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=6c7099627b964e91870043f512b8b7dc) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:07.093035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92638a-fd7d-4dea-b5db-eb028a48aa24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:07.094482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92638a-fd7d-4dea-b5db-eb028a48aa24 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:07.100882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 461/902] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:06 2022] GET /identity/v3/role_assignments?user.id=6c7099627b964e91870043f512b8b7dc&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=234ada2bd8934cae8ffecb7e13fc8a96 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:07.358783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579489b-e0a6-41c9-b5ae-692859fc292f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:07.358990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579489b-e0a6-41c9-b5ae-692859fc292f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:07.359264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579489b-e0a6-41c9-b5ae-692859fc292f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:07.363754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 442/903] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:07.371533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34f32-43e2-4ffe-ad9a-a4c55f877e8d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:07.375329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34f32-43e2-4ffe-ad9a-a4c55f877e8d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:07.375897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34f32-43e2-4ffe-ad9a-a4c55f877e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:07.394372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5fc34f32-43e2-4ffe-ad9a-a4c55f877e8d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:07.395903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5fc34f32-43e2-4ffe-ad9a-a4c55f877e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:07.467286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 462/904] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:07.490119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579489b-e0a6-41c9-b5ae-692859fc292f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:07.554695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:07.599957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579489b-e0a6-41c9-b5ae-692859fc292f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:07.638998 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91933403-caff-4c36-b142-73573901f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:07.640192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91933403-caff-4c36-b142-73573901f952 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:07.640691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91933403-caff-4c36-b142-73573901f952 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:07.641184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91933403-caff-4c36-b142-73573901f952 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:07.642083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91933403-caff-4c36-b142-73573901f952 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:07.643689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91933403-caff-4c36-b142-73573901f952 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-91933403-caff-4c36-b142-73573901f952 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:07.657149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:07.658141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:06:07.658976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:07.661986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 443/905] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Jul 14 09:06:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:07.668029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc34f32-43e2-4ffe-ad9a-a4c55f877e8d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:07.764919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:07.772241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc34f32-43e2-4ffe-ad9a-a4c55f877e8d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:07.811322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c1ab9-7a55-46c3-82cd-61130b8c03f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:07.812364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c1ab9-7a55-46c3-82cd-61130b8c03f8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:07.812872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c1ab9-7a55-46c3-82cd-61130b8c03f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:07.813379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c1ab9-7a55-46c3-82cd-61130b8c03f8 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:07.814279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c1ab9-7a55-46c3-82cd-61130b8c03f8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:07.814849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c1ab9-7a55-46c3-82cd-61130b8c03f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:07.816437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c1ab9-7a55-46c3-82cd-61130b8c03f8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:07.821793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 463/906] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:07.827804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91933403-caff-4c36-b142-73573901f952 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:07.932876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91933403-caff-4c36-b142-73573901f952 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:07.957135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:07.969166 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b557d-0694-4f08-9775-b0af181224c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:07.970111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b557d-0694-4f08-9775-b0af181224c4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:07.970587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b557d-0694-4f08-9775-b0af181224c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:07.971096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b557d-0694-4f08-9775-b0af181224c4 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:07.972029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b557d-0694-4f08-9775-b0af181224c4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:07.972554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b557d-0694-4f08-9775-b0af181224c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:07.974275 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b557d-0694-4f08-9775-b0af181224c4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:07.979695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 444/907] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:07.985879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c1ab9-7a55-46c3-82cd-61130b8c03f8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:07.994312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e479b-71f9-43e0-bd31-9d043fab64b7 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:07.994602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e479b-71f9-43e0-bd31-9d043fab64b7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:07.994885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e479b-71f9-43e0-bd31-9d043fab64b7 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:07.996473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 445/908] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:08.001655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d30c4c-5e37-4cf4-835e-0e572fa84b48 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:08.001944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d30c4c-5e37-4cf4-835e-0e572fa84b48 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:08.002227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d30c4c-5e37-4cf4-835e-0e572fa84b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:08.019479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c0d30c4c-5e37-4cf4-835e-0e572fa84b48 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:08.020748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c0d30c4c-5e37-4cf4-835e-0e572fa84b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:08.097100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 446/909] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:06:08.103028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c1ab9-7a55-46c3-82cd-61130b8c03f8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:08.118355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d30c4c-5e37-4cf4-835e-0e572fa84b48 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:08.144362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6510e6-31a0-4db5-85b1-98f72630b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:08.145695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6510e6-31a0-4db5-85b1-98f72630b721 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:08.146176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6510e6-31a0-4db5-85b1-98f72630b721 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:08.146845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6510e6-31a0-4db5-85b1-98f72630b721 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:08.148152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6510e6-31a0-4db5-85b1-98f72630b721 None admin] RBAC: Adding query filter params (interface=public, service_id=a92435babe34489aa9e9fb8bd713f790, region_id=RegionOne) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:08.148868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6510e6-31a0-4db5-85b1-98f72630b721 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:08.150869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6510e6-31a0-4db5-85b1-98f72630b721 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:08.161746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 464/910] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jul 14 09:06:07 2022] GET /identity/v3/endpoints?service_id=a92435babe34489aa9e9fb8bd713f790&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:08.170619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6510e6-31a0-4db5-85b1-98f72630b721 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:08.198982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:08.249389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d30c4c-5e37-4cf4-835e-0e572fa84b48 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:08.271748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:08.291425 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c44da-3cd2-4e4d-aeb3-e29b94c42308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:08.292034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6510e6-31a0-4db5-85b1-98f72630b721 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:08.292171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c44da-3cd2-4e4d-aeb3-e29b94c42308 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:08.292412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c44da-3cd2-4e4d-aeb3-e29b94c42308 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:08.292730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c44da-3cd2-4e4d-aeb3-e29b94c42308 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:08.293566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c44da-3cd2-4e4d-aeb3-e29b94c42308 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:08.295123 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c44da-3cd2-4e4d-aeb3-e29b94c42308 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:08.316267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 447/911] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:06:08 2022] POST /identity/v3/services => generated 241 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:08.337986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7becc-e18a-49e2-8dac-f182fa12e93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:08.339059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7becc-e18a-49e2-8dac-f182fa12e93f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:08.339542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7becc-e18a-49e2-8dac-f182fa12e93f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:08.340009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7becc-e18a-49e2-8dac-f182fa12e93f None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:08.341101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7becc-e18a-49e2-8dac-f182fa12e93f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:08.342872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7becc-e18a-49e2-8dac-f182fa12e93f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:08.350409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 465/912] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jul 14 09:06:08 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:06:08.715706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ba94-b572-4a4e-8b7f-784b5598d4c2 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:08.716277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ba94-b572-4a4e-8b7f-784b5598d4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:08.716277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ba94-b572-4a4e-8b7f-784b5598d4c2 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:08.717924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 448/913] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:08.723410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09aa66-903b-402b-8639-008559408d92 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:08.723912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09aa66-903b-402b-8639-008559408d92 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:08.723988 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09aa66-903b-402b-8639-008559408d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:08.741134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1e09aa66-903b-402b-8639-008559408d92 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:08.742349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1e09aa66-903b-402b-8639-008559408d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:08.811046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 466/914] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:08.833842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ba94-b572-4a4e-8b7f-784b5598d4c2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:08.941207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ba94-b572-4a4e-8b7f-784b5598d4c2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:08.977034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911c212-4f5b-469c-a7a8-983172347ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:08.977780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911c212-4f5b-469c-a7a8-983172347ffa None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:08.978065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911c212-4f5b-469c-a7a8-983172347ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:08.978341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911c212-4f5b-469c-a7a8-983172347ffa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:08.978998 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911c212-4f5b-469c-a7a8-983172347ffa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:08.980383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911c212-4f5b-469c-a7a8-983172347ffa None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3911c212-4f5b-469c-a7a8-983172347ffa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:08.992878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:08.993920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:08.994782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 449/915] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:06:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:09.000581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09aa66-903b-402b-8639-008559408d92 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:09.014790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:09.106824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09aa66-903b-402b-8639-008559408d92 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:09.143258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f9f3-f2f9-4c20-9291-ba31ba3b247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:09.144432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f9f3-f2f9-4c20-9291-ba31ba3b247a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:09.144882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f9f3-f2f9-4c20-9291-ba31ba3b247a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:09.145347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f9f3-f2f9-4c20-9291-ba31ba3b247a None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:09.146203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f9f3-f2f9-4c20-9291-ba31ba3b247a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:09.146647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f9f3-f2f9-4c20-9291-ba31ba3b247a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:09.148145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f9f3-f2f9-4c20-9291-ba31ba3b247a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:09.154000 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 467/916] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:06:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:09.159442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911c212-4f5b-469c-a7a8-983172347ffa None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:09.165386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1652-7e62-4196-b9b9-43f31eb2d980 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:09.165674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1652-7e62-4196-b9b9-43f31eb2d980 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:09.165955 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1652-7e62-4196-b9b9-43f31eb2d980 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:09.171127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 468/917] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:06:09.172711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c330c-faba-464d-90b6-a1b81db35530 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:09.173002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c330c-faba-464d-90b6-a1b81db35530 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:09.173275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c330c-faba-464d-90b6-a1b81db35530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:09.190110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-bb0c330c-faba-464d-90b6-a1b81db35530 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:09.191286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bb0c330c-faba-464d-90b6-a1b81db35530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:09.212151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:09.272207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 469/918] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:09.284367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911c212-4f5b-469c-a7a8-983172347ffa None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:09.290639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c330c-faba-464d-90b6-a1b81db35530 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:09.304682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:09.321853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540543f-9467-4100-b3dd-76f5a09025f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:09.322590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540543f-9467-4100-b3dd-76f5a09025f5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:09.322879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540543f-9467-4100-b3dd-76f5a09025f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:09.323154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540543f-9467-4100-b3dd-76f5a09025f5 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:09.323867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540543f-9467-4100-b3dd-76f5a09025f5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:09.324174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540543f-9467-4100-b3dd-76f5a09025f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:09.325616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540543f-9467-4100-b3dd-76f5a09025f5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:09.330877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 450/919] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jul 14 09:06:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:09.337575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540543f-9467-4100-b3dd-76f5a09025f5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:09.400695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c330c-faba-464d-90b6-a1b81db35530 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:09.439682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc13e6-92b7-4a34-9211-cde4f8f570dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:09.440490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc13e6-92b7-4a34-9211-cde4f8f570dc None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:09.440796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc13e6-92b7-4a34-9211-cde4f8f570dc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:09.441060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc13e6-92b7-4a34-9211-cde4f8f570dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:09.453014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc13e6-92b7-4a34-9211-cde4f8f570dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:09.455904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540543f-9467-4100-b3dd-76f5a09025f5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-eddc13e6-92b7-4a34-9211-cde4f8f570dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:09.461244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:09.462200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:09.463045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:09.467648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 470/920] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jul 14 09:06:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:09.469276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:09.469891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc13e6-92b7-4a34-9211-cde4f8f570dc None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:09.497811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca284e-2545-4d10-a87a-0bf5c1c26d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:09.498785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca284e-2545-4d10-a87a-0bf5c1c26d82 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:09.499247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca284e-2545-4d10-a87a-0bf5c1c26d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:09.499731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca284e-2545-4d10-a87a-0bf5c1c26d82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:09.500676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca284e-2545-4d10-a87a-0bf5c1c26d82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:09.502217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca284e-2545-4d10-a87a-0bf5c1c26d82 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:09.533129 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 451/921] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jul 14 09:06:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:09.546957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:09.587183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc13e6-92b7-4a34-9211-cde4f8f570dc None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:09.631747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b246f7-b88b-44fe-be04-acb210798a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:09.632476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b246f7-b88b-44fe-be04-acb210798a90 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:09.632832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b246f7-b88b-44fe-be04-acb210798a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:09.633108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b246f7-b88b-44fe-be04-acb210798a90 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:09.633951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b246f7-b88b-44fe-be04-acb210798a90 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:09.634254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b246f7-b88b-44fe-be04-acb210798a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:09.635670 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b246f7-b88b-44fe-be04-acb210798a90 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:09.650005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 471/922] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jul 14 09:06:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:09.651613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca284e-2545-4d10-a87a-0bf5c1c26d82 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:09.762013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca284e-2545-4d10-a87a-0bf5c1c26d82 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:09.799652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d4a9f-4997-4b3e-95f7-1a4817b53d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:09.800832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d4a9f-4997-4b3e-95f7-1a4817b53d31 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:09.801319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d4a9f-4997-4b3e-95f7-1a4817b53d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:09.801840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d4a9f-4997-4b3e-95f7-1a4817b53d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:09.813437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d4a9f-4997-4b3e-95f7-1a4817b53d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:09.815234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d4a9f-4997-4b3e-95f7-1a4817b53d31 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e42d4a9f-4997-4b3e-95f7-1a4817b53d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:09.833111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:09.834018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:09.834935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:09.834935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:09.834935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:09.834935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:09.837145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 452/923] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:09.845142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b246f7-b88b-44fe-be04-acb210798a90 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:09.948276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b246f7-b88b-44fe-be04-acb210798a90 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:09.972727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:09.984152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d53f0-8392-4036-aa94-469e1412fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:09.985329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d53f0-8392-4036-aa94-469e1412fb1f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:09.985868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d53f0-8392-4036-aa94-469e1412fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:09.986537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d53f0-8392-4036-aa94-469e1412fb1f None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:09.987260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d53f0-8392-4036-aa94-469e1412fb1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:09.987561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d53f0-8392-4036-aa94-469e1412fb1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:09.988957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d53f0-8392-4036-aa94-469e1412fb1f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:10.006460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 472/924] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:10.007846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d4a9f-4997-4b3e-95f7-1a4817b53d31 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:10.029443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:10.120896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d4a9f-4997-4b3e-95f7-1a4817b53d31 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:10.164470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb437e76-7848-49b2-b843-cb10c9d37695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:10.165330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437e76-7848-49b2-b843-cb10c9d37695 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.165609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437e76-7848-49b2-b843-cb10c9d37695 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.165878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437e76-7848-49b2-b843-cb10c9d37695 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.174077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb437e76-7848-49b2-b843-cb10c9d37695 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:10.175519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb437e76-7848-49b2-b843-cb10c9d37695 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-bb437e76-7848-49b2-b843-cb10c9d37695 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:06:10.190422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:10.191373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:10.192512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 453/925] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jul 14 09:06:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:10.199355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d53f0-8392-4036-aa94-469e1412fb1f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:10.300573 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d53f0-8392-4036-aa94-469e1412fb1f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:10.336164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed946f3-fb35-48b4-94e7-4ce8df7488fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:10.337339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed946f3-fb35-48b4-94e7-4ce8df7488fd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.337831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed946f3-fb35-48b4-94e7-4ce8df7488fd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.338323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed946f3-fb35-48b4-94e7-4ce8df7488fd None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.339354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed946f3-fb35-48b4-94e7-4ce8df7488fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:10.339916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed946f3-fb35-48b4-94e7-4ce8df7488fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:10.342087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed946f3-fb35-48b4-94e7-4ce8df7488fd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:10.364863 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 473/926] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jul 14 09:06:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:10.367195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb437e76-7848-49b2-b843-cb10c9d37695 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:10.451848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:10.460600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872f044-dd6c-4d28-9622-72f717268065 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.461231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872f044-dd6c-4d28-9622-72f717268065 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.461716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872f044-dd6c-4d28-9622-72f717268065 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.463780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 474/927] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:06:10.471101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5b02-2bbe-480c-a916-ec1c4923ab49 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.471101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5b02-2bbe-480c-a916-ec1c4923ab49 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.471101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5b02-2bbe-480c-a916-ec1c4923ab49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.486808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb437e76-7848-49b2-b843-cb10c9d37695 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:10.492946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f23e5b02-2bbe-480c-a916-ec1c4923ab49 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:10.494147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f23e5b02-2bbe-480c-a916-ec1c4923ab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:10.524056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b0a0a-66b4-4e30-8533-315ca1c1a5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:10.524895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b0a0a-66b4-4e30-8533-315ca1c1a5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.525179 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b0a0a-66b4-4e30-8533-315ca1c1a5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.525455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b0a0a-66b4-4e30-8533-315ca1c1a5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.533894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:10.537663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b0a0a-66b4-4e30-8533-315ca1c1a5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:10.539108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b0a0a-66b4-4e30-8533-315ca1c1a5f5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-655b0a0a-66b4-4e30-8533-315ca1c1a5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:10.557666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:10.558667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:10.559584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:10.559584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:10.559584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:10.559584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:10.559584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 454/928] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:10.560403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608a7b2-cff7-490f-b84b-b8184873d1bc None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.560403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608a7b2-cff7-490f-b84b-b8184873d1bc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.560695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608a7b2-cff7-490f-b84b-b8184873d1bc None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.562101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 455/929] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:10.565805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608a7b2-cff7-490f-b84b-b8184873d1bc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:10.572010 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 475/930] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:10.573320 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007d3d-77f4-42ac-8a5f-ee5a42831f6b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.573604 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007d3d-77f4-42ac-8a5f-ee5a42831f6b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.573876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007d3d-77f4-42ac-8a5f-ee5a42831f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.595024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a3007d3d-77f4-42ac-8a5f-ee5a42831f6b None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:10.596591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a3007d3d-77f4-42ac-8a5f-ee5a42831f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:10.666306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 476/931] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:10.667094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3007d3d-77f4-42ac-8a5f-ee5a42831f6b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:10.689187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608a7b2-cff7-490f-b84b-b8184873d1bc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:10.719984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:10.730637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fdf53-e2c5-4206-a82a-c1fe25b16f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:10.731318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fdf53-e2c5-4206-a82a-c1fe25b16f65 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.731601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fdf53-e2c5-4206-a82a-c1fe25b16f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.731874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fdf53-e2c5-4206-a82a-c1fe25b16f65 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.732596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fdf53-e2c5-4206-a82a-c1fe25b16f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:10.732920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fdf53-e2c5-4206-a82a-c1fe25b16f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:10.734273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fdf53-e2c5-4206-a82a-c1fe25b16f65 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:10.749035 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 456/932] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:10.749945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fdf53-e2c5-4206-a82a-c1fe25b16f65 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:10.777829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3007d3d-77f4-42ac-8a5f-ee5a42831f6b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:10.780302 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:10.815068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40909af4-b776-46c4-95bb-2bf32c391cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:10.815883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40909af4-b776-46c4-95bb-2bf32c391cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.816161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40909af4-b776-46c4-95bb-2bf32c391cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.816431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40909af4-b776-46c4-95bb-2bf32c391cf8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.817108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40909af4-b776-46c4-95bb-2bf32c391cf8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:10.818677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40909af4-b776-46c4-95bb-2bf32c391cf8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-40909af4-b776-46c4-95bb-2bf32c391cf8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:10.831501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:10.832614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:10.833545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 477/933] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:10.835153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40909af4-b776-46c4-95bb-2bf32c391cf8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:10.866916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fdf53-e2c5-4206-a82a-c1fe25b16f65 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:10.901532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1ef70-6fb8-4b42-8ffb-27be4d30a7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:10.902748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1ef70-6fb8-4b42-8ffb-27be4d30a7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.903038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1ef70-6fb8-4b42-8ffb-27be4d30a7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.903308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1ef70-6fb8-4b42-8ffb-27be4d30a7b7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.904046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1ef70-6fb8-4b42-8ffb-27be4d30a7b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:10.905421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1ef70-6fb8-4b42-8ffb-27be4d30a7b7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-1cf1ef70-6fb8-4b42-8ffb-27be4d30a7b7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:10.917590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:10.918782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:10.919708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 457/934] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Jul 14 09:06:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:10.920564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1ef70-6fb8-4b42-8ffb-27be4d30a7b7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:10.942062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40909af4-b776-46c4-95bb-2bf32c391cf8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:10.973611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:10.979291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7fa7c-abac-4428-8899-defe53c7f108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:10.980094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7fa7c-abac-4428-8899-defe53c7f108 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:10.980471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7fa7c-abac-4428-8899-defe53c7f108 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:10.981056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7fa7c-abac-4428-8899-defe53c7f108 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:10.987956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7fa7c-abac-4428-8899-defe53c7f108 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:10.989435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7fa7c-abac-4428-8899-defe53c7f108 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-20b7fa7c-abac-4428-8899-defe53c7f108 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:06:11.003990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:11.004981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:11.005889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:06:11.005889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:06:11.005889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:06:11.005889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:06:11.005889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:06:11.005889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:06:11.005889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:11.005889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:11.005889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 478/935] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:11.006406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7fa7c-abac-4428-8899-defe53c7f108 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:11.034032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:11.036940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1ef70-6fb8-4b42-8ffb-27be4d30a7b7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:11.077187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce0a4c-fbe2-4c36-a30c-106caa34e63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:11.077855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce0a4c-fbe2-4c36-a30c-106caa34e63f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.078141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce0a4c-fbe2-4c36-a30c-106caa34e63f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.078417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce0a4c-fbe2-4c36-a30c-106caa34e63f None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.079672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce0a4c-fbe2-4c36-a30c-106caa34e63f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:11.079984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce0a4c-fbe2-4c36-a30c-106caa34e63f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:11.081471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce0a4c-fbe2-4c36-a30c-106caa34e63f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:11.091037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 458/936] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jul 14 09:06:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:11.091037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce0a4c-fbe2-4c36-a30c-106caa34e63f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:11.113835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7fa7c-abac-4428-8899-defe53c7f108 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:11.149071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bd7ad-ada6-41c1-85fe-729140717f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:11.149808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bd7ad-ada6-41c1-85fe-729140717f2c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.150093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bd7ad-ada6-41c1-85fe-729140717f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.150367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bd7ad-ada6-41c1-85fe-729140717f2c None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.151083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bd7ad-ada6-41c1-85fe-729140717f2c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:11.151389 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bd7ad-ada6-41c1-85fe-729140717f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:11.153265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bd7ad-ada6-41c1-85fe-729140717f2c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:11.158730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 479/937] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:11.159401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bd7ad-ada6-41c1-85fe-729140717f2c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:11.197085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce0a4c-fbe2-4c36-a30c-106caa34e63f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:11.210754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:11.232955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3fe63-5bbb-4df0-afef-503f86f9ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:11.233624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3fe63-5bbb-4df0-afef-503f86f9ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.233904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3fe63-5bbb-4df0-afef-503f86f9ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.234174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3fe63-5bbb-4df0-afef-503f86f9ecb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.234960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3fe63-5bbb-4df0-afef-503f86f9ecb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:11.235268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3fe63-5bbb-4df0-afef-503f86f9ecb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:11.236711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3fe63-5bbb-4df0-afef-503f86f9ecb5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:11.254445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 459/938] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:11.254445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3fe63-5bbb-4df0-afef-503f86f9ecb5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:11.262278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:11.274364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bd7ad-ada6-41c1-85fe-729140717f2c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:11.315021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154d88c-7284-4df1-93f1-f80577b3d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:11.315786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d88c-7284-4df1-93f1-f80577b3d89a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.315975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d88c-7284-4df1-93f1-f80577b3d89a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.316229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d88c-7284-4df1-93f1-f80577b3d89a None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.316990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154d88c-7284-4df1-93f1-f80577b3d89a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:11.317292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154d88c-7284-4df1-93f1-f80577b3d89a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:11.318660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154d88c-7284-4df1-93f1-f80577b3d89a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:11.323657 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 480/939] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jul 14 09:06:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:11.324498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154d88c-7284-4df1-93f1-f80577b3d89a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:11.359244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3fe63-5bbb-4df0-afef-503f86f9ecb5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:11.400404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c63de-2015-4d97-a8f1-84c5fc945258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:11.401221 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c63de-2015-4d97-a8f1-84c5fc945258 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.401356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c63de-2015-4d97-a8f1-84c5fc945258 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.401627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c63de-2015-4d97-a8f1-84c5fc945258 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.402751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c63de-2015-4d97-a8f1-84c5fc945258 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:11.403141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c63de-2015-4d97-a8f1-84c5fc945258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:11.404386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c63de-2015-4d97-a8f1-84c5fc945258 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:11.414101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 460/940] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:11.414960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c63de-2015-4d97-a8f1-84c5fc945258 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:11.446434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154d88c-7284-4df1-93f1-f80577b3d89a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:11.458406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:11.482724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0e7c4-b68d-4bf4-b065-62c38f47ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:11.483618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e7c4-b68d-4bf4-b065-62c38f47ad92 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.483902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e7c4-b68d-4bf4-b065-62c38f47ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.484169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e7c4-b68d-4bf4-b065-62c38f47ad92 None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/6c7099627b964e91870043f512b8b7dc/roles/234ada2bd8934cae8ffecb7e13fc8a96` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.486508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0e7c4-b68d-4bf4-b065-62c38f47ad92 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=6c7099627b964e91870043f512b8b7dc, role_id=234ada2bd8934cae8ffecb7e13fc8a96)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:11.487934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0e7c4-b68d-4bf4-b065-62c38f47ad92 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:11.502259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 481/941] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:06:11 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/6c7099627b964e91870043f512b8b7dc/roles/234ada2bd8934cae8ffecb7e13fc8a96 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:06:11.505527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0e7c4-b68d-4bf4-b065-62c38f47ad92 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:11.528690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c63de-2015-4d97-a8f1-84c5fc945258 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:11.532341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:11.570784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8485-12df-42a3-8963-e80223fba36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:11.571467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8485-12df-42a3-8963-e80223fba36d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.571785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8485-12df-42a3-8963-e80223fba36d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.572061 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8485-12df-42a3-8963-e80223fba36d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.572924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf8485-12df-42a3-8963-e80223fba36d None admin] RBAC: Adding query filter params (interface=public, service_id=342398ae883d44deb7cb2694f196be98, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:11.573287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf8485-12df-42a3-8963-e80223fba36d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:11.574806 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf8485-12df-42a3-8963-e80223fba36d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:11.585748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 461/942] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jul 14 09:06:11 2022] GET /identity/v3/endpoints?service_id=342398ae883d44deb7cb2694f196be98&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:11.586733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8485-12df-42a3-8963-e80223fba36d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:11.656335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0e7c4-b68d-4bf4-b065-62c38f47ad92 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:11.702062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8485-12df-42a3-8963-e80223fba36d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:11.703676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:11.703785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dd25f-df1d-4c2f-98e8-f35bc23b5148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:11.705250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd25f-df1d-4c2f-98e8-f35bc23b5148 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.705544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd25f-df1d-4c2f-98e8-f35bc23b5148 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.705868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd25f-df1d-4c2f-98e8-f35bc23b5148 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.706746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dd25f-df1d-4c2f-98e8-f35bc23b5148 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:11.708187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dd25f-df1d-4c2f-98e8-f35bc23b5148 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:11.730656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 482/943] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jul 14 09:06:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:11.732251 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3fd5-b950-42d0-b9e0-1d181f6e0d37 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.732539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3fd5-b950-42d0-b9e0-1d181f6e0d37 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.732834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3fd5-b950-42d0-b9e0-1d181f6e0d37 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.736705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 483/944] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:11.739968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfac1b-7c39-4741-9f3c-0e49ce8fcf86 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.740474 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfac1b-7c39-4741-9f3c-0e49ce8fcf86 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.741046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfac1b-7c39-4741-9f3c-0e49ce8fcf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.758609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527a0d-f0cc-49fd-afe1-92460e2c585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:11.759449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527a0d-f0cc-49fd-afe1-92460e2c585c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:11.759832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527a0d-f0cc-49fd-afe1-92460e2c585c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:11.760043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-dadfac1b-7c39-4741-9f3c-0e49ce8fcf86 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:11.760309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527a0d-f0cc-49fd-afe1-92460e2c585c None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:11.761164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527a0d-f0cc-49fd-afe1-92460e2c585c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:11.761949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-dadfac1b-7c39-4741-9f3c-0e49ce8fcf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:11.762887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527a0d-f0cc-49fd-afe1-92460e2c585c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:11.776912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 462/945] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jul 14 09:06:11 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:06:11.850738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:11.858000 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 484/946] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:11.883013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527a0d-f0cc-49fd-afe1-92460e2c585c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:11.995930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527a0d-f0cc-49fd-afe1-92460e2c585c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:12.031583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:12.032255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:12.032538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:12.032858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:12.033586 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:12.035008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:12.036380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: WARNING keystone.server.flask.common [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 09:06:12.055377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.sql.core [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 09:06:12.055377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 09:06:12.055377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [parameters: {'id': 'd5ca735644644a2187617288e6bc5612', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 09:06:12.055377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80205) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5ca735644644a2187617288e6bc5612.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5ca735644644a2187617288e6bc5612. Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:06:12.063688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result.read() Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 09:06:12.064717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application yield resource Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise self.value Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application session.commit() Jul 14 09:06:12.065691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.session.flush() Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application compat.raise_( Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 09:06:12.066568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 09:06:12.067452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result.read() Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:06:12.068240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [parameters: {'id': 'd5ca735644644a2187617288e6bc5612', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:12.069359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:12.070205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:12.071730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:12.071730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 09:06:12.071730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 09:06:12.071730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:12.071730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:12.071730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 09:06:12.071730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 09:06:12.071730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5ca735644644a2187617288e6bc5612. Jul 14 09:06:12.071730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:12.071730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 463/947] 10.222.0.27 () {60 vars in 1140 bytes} [Thu Jul 14 09:06:11 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:12.072677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfac1b-7c39-4741-9f3c-0e49ce8fcf86 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:12.179082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfac1b-7c39-4741-9f3c-0e49ce8fcf86 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:12.214740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961e2fa-6b39-4139-ab09-3ccb5b8684c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:12.215733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961e2fa-6b39-4139-ab09-3ccb5b8684c6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:12.216083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961e2fa-6b39-4139-ab09-3ccb5b8684c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:12.216364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961e2fa-6b39-4139-ab09-3ccb5b8684c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:12.224032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961e2fa-6b39-4139-ab09-3ccb5b8684c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:12.225524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961e2fa-6b39-4139-ab09-3ccb5b8684c6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b961e2fa-6b39-4139-ab09-3ccb5b8684c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:06:12.240513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:12.242641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:12.244720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:06:12.244720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:06:12.244720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:06:12.244720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:06:12.244720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:06:12.244720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:06:12.244720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:12.244720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:12.244720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 485/948] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:12.250387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:12.274364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:12.356323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30f71-2275-4965-9642-74486af4ec03 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:12.396295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531fe57-ecc8-44a3-8739-1a859ddec1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:12.397013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531fe57-ecc8-44a3-8739-1a859ddec1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:12.397433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531fe57-ecc8-44a3-8739-1a859ddec1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:12.397710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531fe57-ecc8-44a3-8739-1a859ddec1e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:12.398477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531fe57-ecc8-44a3-8739-1a859ddec1e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:12.398781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531fe57-ecc8-44a3-8739-1a859ddec1e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:12.400421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531fe57-ecc8-44a3-8739-1a859ddec1e5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:12.421556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 464/949] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:06:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:13.566844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb19f7-526b-4908-8037-0f76be9cd783 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:13.567401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb19f7-526b-4908-8037-0f76be9cd783 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:13.567401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb19f7-526b-4908-8037-0f76be9cd783 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:13.569122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 486/950] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:13.575402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbab1-7496-483d-8ad8-34006c137e99 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:13.575918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbab1-7496-483d-8ad8-34006c137e99 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:13.575995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbab1-7496-483d-8ad8-34006c137e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:13.593606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-bfabbab1-7496-483d-8ad8-34006c137e99 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:13.595117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bfabbab1-7496-483d-8ad8-34006c137e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:13.670269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 465/951] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:13.693265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb19f7-526b-4908-8037-0f76be9cd783 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:13.754565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:13.797535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb19f7-526b-4908-8037-0f76be9cd783 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:13.831329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1c58-d914-42a7-a099-366b393b65b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:13.832151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1c58-d914-42a7-a099-366b393b65b3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:13.832435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1c58-d914-42a7-a099-366b393b65b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:13.832740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1c58-d914-42a7-a099-366b393b65b3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:13.843771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a1c58-d914-42a7-a099-366b393b65b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-874a1c58-d914-42a7-a099-366b393b65b3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:13.851808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:13.852771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:13.853864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 487/952] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jul 14 09:06:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:13.859026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363de263-fb6b-4b27-a9fa-aaf790cde241 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:13.859311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1c58-d914-42a7-a099-366b393b65b3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:13.859413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363de263-fb6b-4b27-a9fa-aaf790cde241 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:13.859678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363de263-fb6b-4b27-a9fa-aaf790cde241 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:13.861481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 466/953] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:13.866300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eed94-21de-4e5f-8b50-f58b91054ee5 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:13.866589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eed94-21de-4e5f-8b50-f58b91054ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:13.866863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eed94-21de-4e5f-8b50-f58b91054ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:13.885504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-059eed94-21de-4e5f-8b50-f58b91054ee5 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:13.886887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-059eed94-21de-4e5f-8b50-f58b91054ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:13.888942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:13.967023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1c58-d914-42a7-a099-366b393b65b3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:13.973056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 467/954] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:13.976298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29f94-baa4-4f46-814d-e2b6d35cf0b3 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:13.976298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29f94-baa4-4f46-814d-e2b6d35cf0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:13.976298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29f94-baa4-4f46-814d-e2b6d35cf0b3 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:13.976298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 468/955] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:13.982213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9af06-80ec-437f-aadb-bff49231ec8c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:13.982617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9af06-80ec-437f-aadb-bff49231ec8c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:13.982999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9af06-80ec-437f-aadb-bff49231ec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:13.992867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:14.001688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0ff9af06-80ec-437f-aadb-bff49231ec8c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:14.002898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0ff9af06-80ec-437f-aadb-bff49231ec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:14.009841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e02cbc-f6be-4210-994f-97ac75cdd21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:14.011010 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e02cbc-f6be-4210-994f-97ac75cdd21c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.011309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e02cbc-f6be-4210-994f-97ac75cdd21c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.011588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e02cbc-f6be-4210-994f-97ac75cdd21c None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.012348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e02cbc-f6be-4210-994f-97ac75cdd21c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:14.013031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e02cbc-f6be-4210-994f-97ac75cdd21c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:14.014742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e02cbc-f6be-4210-994f-97ac75cdd21c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:14.030118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 488/956] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jul 14 09:06:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:14.030118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e02cbc-f6be-4210-994f-97ac75cdd21c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.072148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 469/957] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:14.073095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9af06-80ec-437f-aadb-bff49231ec8c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.142666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e02cbc-f6be-4210-994f-97ac75cdd21c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:14.155012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:14.179825 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a8db0-edec-47fd-b87c-1f01bcb8e881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:14.181013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a8db0-edec-47fd-b87c-1f01bcb8e881 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.181464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a8db0-edec-47fd-b87c-1f01bcb8e881 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.181916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a8db0-edec-47fd-b87c-1f01bcb8e881 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.183382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a8db0-edec-47fd-b87c-1f01bcb8e881 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:14.185601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a8db0-edec-47fd-b87c-1f01bcb8e881 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:14.203097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9af06-80ec-437f-aadb-bff49231ec8c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5a7a8db0-edec-47fd-b87c-1f01bcb8e881 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:14.205430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:14.206785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:14.213114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 489/958] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:14.214138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a8db0-edec-47fd-b87c-1f01bcb8e881 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.252180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaacaa-7dd9-4fbf-b509-1e49e5797474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:14.253046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaacaa-7dd9-4fbf-b509-1e49e5797474 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.253388 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaacaa-7dd9-4fbf-b509-1e49e5797474 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.253722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaacaa-7dd9-4fbf-b509-1e49e5797474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.264305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaacaa-7dd9-4fbf-b509-1e49e5797474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:14.265542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:14.265910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaacaa-7dd9-4fbf-b509-1e49e5797474 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-6cbaacaa-7dd9-4fbf-b509-1e49e5797474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:14.284396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:14.285583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:14.286779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:14.286779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:14.286779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:14.286779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:14.290423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 470/959] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:14.291295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaacaa-7dd9-4fbf-b509-1e49e5797474 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.329696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a8db0-edec-47fd-b87c-1f01bcb8e881 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:14.368373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41f46d-08ff-4013-a603-6cafb09dd686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:14.369222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41f46d-08ff-4013-a603-6cafb09dd686 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.369507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41f46d-08ff-4013-a603-6cafb09dd686 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.369816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41f46d-08ff-4013-a603-6cafb09dd686 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.370781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41f46d-08ff-4013-a603-6cafb09dd686 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:14.372508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41f46d-08ff-4013-a603-6cafb09dd686 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-de41f46d-08ff-4013-a603-6cafb09dd686 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:14.386949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:14.388009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:14.389833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 490/960] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:14.390669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41f46d-08ff-4013-a603-6cafb09dd686 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.406934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaacaa-7dd9-4fbf-b509-1e49e5797474 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:14.429628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:14.445708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6385-867b-4668-923b-1b0bd5d832db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:14.446397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6385-867b-4668-923b-1b0bd5d832db None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.446695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6385-867b-4668-923b-1b0bd5d832db None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.446975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6385-867b-4668-923b-1b0bd5d832db None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.447692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6385-867b-4668-923b-1b0bd5d832db None admin] RBAC: Adding query filter params (name=compute) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:14.448001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6385-867b-4668-923b-1b0bd5d832db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:14.449664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6385-867b-4668-923b-1b0bd5d832db None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:14.455372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 471/961] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:06:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:14.456151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6385-867b-4668-923b-1b0bd5d832db None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.504733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41f46d-08ff-4013-a603-6cafb09dd686 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:14.515221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:14.539033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd80aa-ddd7-4539-a3ea-f7678cbd8bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:14.539701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd80aa-ddd7-4539-a3ea-f7678cbd8bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.539979 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd80aa-ddd7-4539-a3ea-f7678cbd8bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.540255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd80aa-ddd7-4539-a3ea-f7678cbd8bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.540994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd80aa-ddd7-4539-a3ea-f7678cbd8bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:14.541298 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd80aa-ddd7-4539-a3ea-f7678cbd8bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:14.542732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd80aa-ddd7-4539-a3ea-f7678cbd8bf0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:14.554394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 491/962] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:14.555163 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd80aa-ddd7-4539-a3ea-f7678cbd8bf0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.562665 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6385-867b-4668-923b-1b0bd5d832db None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:14.596712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb2b8c-2e68-44db-89fa-c6543abe9373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:14.597391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb2b8c-2e68-44db-89fa-c6543abe9373 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.597674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb2b8c-2e68-44db-89fa-c6543abe9373 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.597949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb2b8c-2e68-44db-89fa-c6543abe9373 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.598659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb2b8c-2e68-44db-89fa-c6543abe9373 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:14.599049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb2b8c-2e68-44db-89fa-c6543abe9373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:14.600332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb2b8c-2e68-44db-89fa-c6543abe9373 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:14.605054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 472/963] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jul 14 09:06:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:14.606331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ae0e-f9cf-4485-8995-4362a43f6a12 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.606623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ae0e-f9cf-4485-8995-4362a43f6a12 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.606899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ae0e-f9cf-4485-8995-4362a43f6a12 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.608717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 473/964] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:14.608900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1ae0e-f9cf-4485-8995-4362a43f6a12 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.656893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd80aa-ddd7-4539-a3ea-f7678cbd8bf0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:14.659568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:14.691930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882fc3d-0b6f-4200-9e43-befa86e347b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:14.692601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882fc3d-0b6f-4200-9e43-befa86e347b8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.692909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882fc3d-0b6f-4200-9e43-befa86e347b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.693181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882fc3d-0b6f-4200-9e43-befa86e347b8 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.693883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882fc3d-0b6f-4200-9e43-befa86e347b8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:14.694181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882fc3d-0b6f-4200-9e43-befa86e347b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:14.695536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882fc3d-0b6f-4200-9e43-befa86e347b8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:14.700106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 492/965] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:06:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:14.700887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882fc3d-0b6f-4200-9e43-befa86e347b8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.711151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1ae0e-f9cf-4485-8995-4362a43f6a12 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:14.751677 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1b7f7-af9f-4447-af60-d9f0101d5bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:14.752517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1b7f7-af9f-4447-af60-d9f0101d5bfe None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.752829 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1b7f7-af9f-4447-af60-d9f0101d5bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.753105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1b7f7-af9f-4447-af60-d9f0101d5bfe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.756618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:14.762212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1b7f7-af9f-4447-af60-d9f0101d5bfe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:14.763905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1b7f7-af9f-4447-af60-d9f0101d5bfe None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-41e1b7f7-af9f-4447-af60-d9f0101d5bfe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:06:14.783773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:14.785049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:14.786020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 474/966] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jul 14 09:06:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:14.786666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b636b28-fae4-41d0-af4d-c9f0fd48312c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.786918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b636b28-fae4-41d0-af4d-c9f0fd48312c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.787187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b636b28-fae4-41d0-af4d-c9f0fd48312c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.804210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2b636b28-fae4-41d0-af4d-c9f0fd48312c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:14.805445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2b636b28-fae4-41d0-af4d-c9f0fd48312c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:14.840771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882fc3d-0b6f-4200-9e43-befa86e347b8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:14.882852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 475/967] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:14.884197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b636b28-fae4-41d0-af4d-c9f0fd48312c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.890026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf0d5e-f987-4103-8060-8a052e61899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:14.890896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf0d5e-f987-4103-8060-8a052e61899d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:14.891359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf0d5e-f987-4103-8060-8a052e61899d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:14.891777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf0d5e-f987-4103-8060-8a052e61899d None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:14.892635 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf0d5e-f987-4103-8060-8a052e61899d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:14.893231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf0d5e-f987-4103-8060-8a052e61899d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:14.894606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf0d5e-f987-4103-8060-8a052e61899d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:14.900458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 493/968] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jul 14 09:06:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:14.907064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf0d5e-f987-4103-8060-8a052e61899d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:14.928651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:14.993510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b636b28-fae4-41d0-af4d-c9f0fd48312c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:15.007917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:15.012090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf0d5e-f987-4103-8060-8a052e61899d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:15.031818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cf58c-6899-468e-a4fe-1965160ab85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:15.032501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cf58c-6899-468e-a4fe-1965160ab85b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:15.032817 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cf58c-6899-468e-a4fe-1965160ab85b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:15.033096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cf58c-6899-468e-a4fe-1965160ab85b None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:15.033969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cf58c-6899-468e-a4fe-1965160ab85b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:15.034283 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cf58c-6899-468e-a4fe-1965160ab85b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:15.035709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cf58c-6899-468e-a4fe-1965160ab85b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:15.049217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f630d2-e75f-4380-9adf-137d38827fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:15.049881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f630d2-e75f-4380-9adf-137d38827fa7 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:15.050159 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f630d2-e75f-4380-9adf-137d38827fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:15.050429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f630d2-e75f-4380-9adf-137d38827fa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:15.051168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f630d2-e75f-4380-9adf-137d38827fa7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:15.052509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f630d2-e75f-4380-9adf-137d38827fa7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:15.059398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 476/969] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jul 14 09:06:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:15.060541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cf58c-6899-468e-a4fe-1965160ab85b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:15.073975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 494/970] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jul 14 09:06:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:06:15.074895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f630d2-e75f-4380-9adf-137d38827fa7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:15.181990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:15.191799 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cf58c-6899-468e-a4fe-1965160ab85b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:15.226885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f630d2-e75f-4380-9adf-137d38827fa7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:15.230419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01435f3-e582-4d9f-8692-3b0b9e0d35c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:15.231430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01435f3-e582-4d9f-8692-3b0b9e0d35c9 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:15.231923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01435f3-e582-4d9f-8692-3b0b9e0d35c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:15.232410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01435f3-e582-4d9f-8692-3b0b9e0d35c9 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:15.233356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01435f3-e582-4d9f-8692-3b0b9e0d35c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:15.235023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01435f3-e582-4d9f-8692-3b0b9e0d35c9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:15.249680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.sql.core [None req-a01435f3-e582-4d9f-8692-3b0b9e0d35c9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 09:06:15.249680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 09:06:15.249680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [parameters: {'user_id': '0508c2e062aa4e9c8f087eabdf94d33d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 09:06:15.249680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80205) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a01435f3-e582-4d9f-8692-3b0b9e0d35c9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result.read() Jul 14 09:06:15.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:06:15.259122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application yield resource Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise self.value Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application session.commit() Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 09:06:15.260115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.session.flush() Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application compat.raise_( Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 09:06:15.261149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:06:15.262262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result.read() Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:06:15.263465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [parameters: {'user_id': '0508c2e062aa4e9c8f087eabdf94d33d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:15.264553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 09:06:15.265774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 09:06:15.266867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 09:06:15.266867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 09:06:15.266867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 09:06:15.266867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 09:06:15.266867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 09:06:15.266867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:15.267297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34d61d-75d3-4bec-92cf-9b99bc0a780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:15.267408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34d61d-75d3-4bec-92cf-9b99bc0a780d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:15.268514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34d61d-75d3-4bec-92cf-9b99bc0a780d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:15.268514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34d61d-75d3-4bec-92cf-9b99bc0a780d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:15.269577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 477/971] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jul 14 09:06:15 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:15.277015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01435f3-e582-4d9f-8692-3b0b9e0d35c9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:15.290460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:15.349951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34d61d-75d3-4bec-92cf-9b99bc0a780d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:15.351580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34d61d-75d3-4bec-92cf-9b99bc0a780d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:15.393524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01435f3-e582-4d9f-8692-3b0b9e0d35c9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:15.431346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef882e4-b10c-4a14-83d2-4a33c9d3dcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:15.432568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef882e4-b10c-4a14-83d2-4a33c9d3dcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:15.433174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef882e4-b10c-4a14-83d2-4a33c9d3dcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:15.433695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef882e4-b10c-4a14-83d2-4a33c9d3dcf2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:15.443843 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef882e4-b10c-4a14-83d2-4a33c9d3dcf2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:15.446053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef882e4-b10c-4a14-83d2-4a33c9d3dcf2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:15.460705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 495/972] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:15 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-cef882e4-b10c-4a14-83d2-4a33c9d3dcf2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:06:15.466647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:15.467583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:15.468523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:15.468523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:15.468523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:06:15.468523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:06:15.468523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:06:15.468523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:06:15.468523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:06:15.468523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:06:15.468523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:06:15.468523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:15.470995 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34d61d-75d3-4bec-92cf-9b99bc0a780d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:15.472538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 478/973] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:06:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:15.473780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef882e4-b10c-4a14-83d2-4a33c9d3dcf2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:15.494454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:15.529624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:15.583032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34d61d-75d3-4bec-92cf-9b99bc0a780d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:15.583457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef882e4-b10c-4a14-83d2-4a33c9d3dcf2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:15.619932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac27a54-c8ab-46c1-b38a-0e84b1bf5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:15.620176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949ced5-3602-495b-a415-0960d1e34666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:15.620934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949ced5-3602-495b-a415-0960d1e34666 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:15.621135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949ced5-3602-495b-a415-0960d1e34666 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:15.621416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949ced5-3602-495b-a415-0960d1e34666 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:15.622229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949ced5-3602-495b-a415-0960d1e34666 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:15.622538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949ced5-3602-495b-a415-0960d1e34666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:15.622781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac27a54-c8ab-46c1-b38a-0e84b1bf5d53 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:15.623257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac27a54-c8ab-46c1-b38a-0e84b1bf5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:15.623751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac27a54-c8ab-46c1-b38a-0e84b1bf5d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:15.623973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949ced5-3602-495b-a415-0960d1e34666 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:15.635120 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac27a54-c8ab-46c1-b38a-0e84b1bf5d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:15.637266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac27a54-c8ab-46c1-b38a-0e84b1bf5d53 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2ac27a54-c8ab-46c1-b38a-0e84b1bf5d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:15.656129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:15.657612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:15.658715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:15.658715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:15.658715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:15.658715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:15.665078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 496/974] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:15.666408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac27a54-c8ab-46c1-b38a-0e84b1bf5d53 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:15.676918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 479/975] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jul 14 09:06:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:15.778481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac27a54-c8ab-46c1-b38a-0e84b1bf5d53 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:15.791485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:15.817439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22265f-8b98-4f29-b99f-6462121c3814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:15.818123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22265f-8b98-4f29-b99f-6462121c3814 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:15.818404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22265f-8b98-4f29-b99f-6462121c3814 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:15.818680 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22265f-8b98-4f29-b99f-6462121c3814 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:15.819506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22265f-8b98-4f29-b99f-6462121c3814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:15.819809 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22265f-8b98-4f29-b99f-6462121c3814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:15.821224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22265f-8b98-4f29-b99f-6462121c3814 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:15.834360 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 497/976] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:15.840118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949ced5-3602-495b-a415-0960d1e34666 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:15.928691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:15.954990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949ced5-3602-495b-a415-0960d1e34666 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:15.989622 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919de6df-1156-4c97-9022-c35baca31763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:15.990799 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919de6df-1156-4c97-9022-c35baca31763 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:15.991288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919de6df-1156-4c97-9022-c35baca31763 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:15.991764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919de6df-1156-4c97-9022-c35baca31763 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:15.998823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919de6df-1156-4c97-9022-c35baca31763 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:16.000503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919de6df-1156-4c97-9022-c35baca31763 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-919de6df-1156-4c97-9022-c35baca31763 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:06:16.014628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:16.015544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:16.016504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:06:16.016504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:06:16.016504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:06:16.016504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:06:16.016504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:06:16.016504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:06:16.016504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:16.016504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:16.018174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 480/977] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:16.023700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22265f-8b98-4f29-b99f-6462121c3814 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:16.129616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22265f-8b98-4f29-b99f-6462121c3814 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:16.164927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125f6bb-a179-4a7e-b913-342b1e2f1d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:16.165961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125f6bb-a179-4a7e-b913-342b1e2f1d67 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:16.166449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125f6bb-a179-4a7e-b913-342b1e2f1d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:16.167026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125f6bb-a179-4a7e-b913-342b1e2f1d67 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:16.168015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125f6bb-a179-4a7e-b913-342b1e2f1d67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:16.168548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125f6bb-a179-4a7e-b913-342b1e2f1d67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:16.170146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125f6bb-a179-4a7e-b913-342b1e2f1d67 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:16.183713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 498/978] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:16.189997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919de6df-1156-4c97-9022-c35baca31763 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:16.302308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919de6df-1156-4c97-9022-c35baca31763 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:16.336819 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef555a-e22a-4bbf-b570-3529320b624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:16.337475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef555a-e22a-4bbf-b570-3529320b624b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:16.337748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef555a-e22a-4bbf-b570-3529320b624b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:16.338022 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef555a-e22a-4bbf-b570-3529320b624b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:16.338961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef555a-e22a-4bbf-b570-3529320b624b None admin] RBAC: Adding query filter params (role.id=234ada2bd8934cae8ffecb7e13fc8a96, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=6c7099627b964e91870043f512b8b7dc) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:16.339273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef555a-e22a-4bbf-b570-3529320b624b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:16.340842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef555a-e22a-4bbf-b570-3529320b624b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:16.343750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:16.352866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 481/979] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:16 2022] GET /identity/v3/role_assignments?user.id=6c7099627b964e91870043f512b8b7dc&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=234ada2bd8934cae8ffecb7e13fc8a96 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:16.834033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eb81d-44c6-4a69-b493-79a809a70dfa None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:16.834574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eb81d-44c6-4a69-b493-79a809a70dfa None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:16.834574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eb81d-44c6-4a69-b493-79a809a70dfa None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:16.836221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 499/980] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:16.842037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ecb59-f789-4ad2-9737-419e3ab55982 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:16.842471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ecb59-f789-4ad2-9737-419e3ab55982 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:16.842663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ecb59-f789-4ad2-9737-419e3ab55982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:16.860900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-392ecb59-f789-4ad2-9737-419e3ab55982 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:16.862459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-392ecb59-f789-4ad2-9737-419e3ab55982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:16.935679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 482/981] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:16.958269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85eb81d-44c6-4a69-b493-79a809a70dfa None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:16.984376 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:17.073002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85eb81d-44c6-4a69-b493-79a809a70dfa None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:17.110696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852072e3-f302-4cd6-acaf-c5675e3913ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:17.111286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852072e3-f302-4cd6-acaf-c5675e3913ff None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:17.111570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852072e3-f302-4cd6-acaf-c5675e3913ff None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:17.111847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852072e3-f302-4cd6-acaf-c5675e3913ff None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:17.112579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852072e3-f302-4cd6-acaf-c5675e3913ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:17.113971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852072e3-f302-4cd6-acaf-c5675e3913ff None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:17.129437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 500/982] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:06:16 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:17.174979 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf15388-2837-4ebf-877d-3691cc18fa10 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:17.175265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf15388-2837-4ebf-877d-3691cc18fa10 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:17.175708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf15388-2837-4ebf-877d-3691cc18fa10 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:17.177356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 483/983] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:17.183571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8bcab-45e4-4c5e-8f14-1676bd3af6e2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:17.183858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8bcab-45e4-4c5e-8f14-1676bd3af6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:17.184103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8bcab-45e4-4c5e-8f14-1676bd3af6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:17.202718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-38d8bcab-45e4-4c5e-8f14-1676bd3af6e2 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:17.203957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-38d8bcab-45e4-4c5e-8f14-1676bd3af6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:17.288430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 501/984] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:17.311834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf15388-2837-4ebf-877d-3691cc18fa10 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:17.423952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf15388-2837-4ebf-877d-3691cc18fa10 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:17.457648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:17.464850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b80bb-dd0a-46e8-b9a3-556490b1a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:17.465675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b80bb-dd0a-46e8-b9a3-556490b1a752 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:17.465959 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b80bb-dd0a-46e8-b9a3-556490b1a752 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:17.466233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b80bb-dd0a-46e8-b9a3-556490b1a752 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:17.466893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b80bb-dd0a-46e8-b9a3-556490b1a752 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:17.468319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b80bb-dd0a-46e8-b9a3-556490b1a752 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f40b80bb-dd0a-46e8-b9a3-556490b1a752 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:17.480873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:17.481947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:17.482777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:17.484159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 484/985] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:17.489112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8bcab-45e4-4c5e-8f14-1676bd3af6e2 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:17.500894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:17.595278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8bcab-45e4-4c5e-8f14-1676bd3af6e2 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:17.634276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536c36d-1b95-4b24-bc30-ecc25352bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:17.634891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c36d-1b95-4b24-bc30-ecc25352bef6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:17.635296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c36d-1b95-4b24-bc30-ecc25352bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:17.635573 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c36d-1b95-4b24-bc30-ecc25352bef6 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:17.636398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536c36d-1b95-4b24-bc30-ecc25352bef6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:17.636736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536c36d-1b95-4b24-bc30-ecc25352bef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:17.638110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536c36d-1b95-4b24-bc30-ecc25352bef6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:17.648291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 502/986] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jul 14 09:06:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:17.649367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b80bb-dd0a-46e8-b9a3-556490b1a752 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:17.754645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b80bb-dd0a-46e8-b9a3-556490b1a752 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:17.790297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdb9fe-8345-4239-a826-2b299debc269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:17.790970 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdb9fe-8345-4239-a826-2b299debc269 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:17.791313 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdb9fe-8345-4239-a826-2b299debc269 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:17.791593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdb9fe-8345-4239-a826-2b299debc269 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:17.792306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdb9fe-8345-4239-a826-2b299debc269 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:17.792616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdb9fe-8345-4239-a826-2b299debc269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:17.794010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdb9fe-8345-4239-a826-2b299debc269 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:17.799295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 485/987] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jul 14 09:06:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:17.805282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536c36d-1b95-4b24-bc30-ecc25352bef6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:17.881430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:17.912892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536c36d-1b95-4b24-bc30-ecc25352bef6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:17.948023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc66d-f425-45cf-88a0-92791e28aaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:17.948687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc66d-f425-45cf-88a0-92791e28aaeb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:17.949002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc66d-f425-45cf-88a0-92791e28aaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:17.949279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc66d-f425-45cf-88a0-92791e28aaeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:17.950064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc66d-f425-45cf-88a0-92791e28aaeb None admin] RBAC: Adding query filter params (interface=admin, service_id=342398ae883d44deb7cb2694f196be98, region_id=RegionOne) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:17.950452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc66d-f425-45cf-88a0-92791e28aaeb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:17.951835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc66d-f425-45cf-88a0-92791e28aaeb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:17.957299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 503/988] 10.222.0.27 () {56 vars in 1249 bytes} [Thu Jul 14 09:06:17 2022] GET /identity/v3/endpoints?service_id=342398ae883d44deb7cb2694f196be98&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:17.962713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdb9fe-8345-4239-a826-2b299debc269 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:18.022049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:18.065964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdb9fe-8345-4239-a826-2b299debc269 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:18.100037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5baba-681e-45fa-80b8-22d21b2c16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:18.100733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5baba-681e-45fa-80b8-22d21b2c16c2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:18.101031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5baba-681e-45fa-80b8-22d21b2c16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:18.101306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5baba-681e-45fa-80b8-22d21b2c16c2 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:18.101994 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5baba-681e-45fa-80b8-22d21b2c16c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:18.103358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5baba-681e-45fa-80b8-22d21b2c16c2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:18.110114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 486/989] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jul 14 09:06:17 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:06:18.442001 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499e6b3-e8fa-420a-96fa-292f1145a46e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:18.442338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499e6b3-e8fa-420a-96fa-292f1145a46e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:18.442549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499e6b3-e8fa-420a-96fa-292f1145a46e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:18.443966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 504/990] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:18.449456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4594a-2a02-42f2-9aa5-1d66cda7c049 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:18.449746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4594a-2a02-42f2-9aa5-1d66cda7c049 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:18.450021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4594a-2a02-42f2-9aa5-1d66cda7c049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:18.468382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-cfc4594a-2a02-42f2-9aa5-1d66cda7c049 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:18.469585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cfc4594a-2a02-42f2-9aa5-1d66cda7c049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:18.541473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 487/991] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:18.563355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499e6b3-e8fa-420a-96fa-292f1145a46e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:18.667361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499e6b3-e8fa-420a-96fa-292f1145a46e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:18.702672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4585ef2-4d0a-4326-8e46-83753e907a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:18.703469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585ef2-4d0a-4326-8e46-83753e907a7b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:18.703746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585ef2-4d0a-4326-8e46-83753e907a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:18.704012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585ef2-4d0a-4326-8e46-83753e907a7b None admin] PATH_INFO: `/v3/services/image` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:18.704678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4585ef2-4d0a-4326-8e46-83753e907a7b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:18.706041 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4585ef2-4d0a-4326-8e46-83753e907a7b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:18.708855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c4585ef2-4d0a-4326-8e46-83753e907a7b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:18.720088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:18.721371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:06:18.722203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:18.726168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 505/992] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Jul 14 09:06:18 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:18.727437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4594a-2a02-42f2-9aa5-1d66cda7c049 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:18.785670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:18.837986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4594a-2a02-42f2-9aa5-1d66cda7c049 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:18.872965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195efef-5c76-4e62-ba08-c0d4a2cb6d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:18.873625 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195efef-5c76-4e62-ba08-c0d4a2cb6d3a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:18.873903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195efef-5c76-4e62-ba08-c0d4a2cb6d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:18.874176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195efef-5c76-4e62-ba08-c0d4a2cb6d3a None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:18.874883 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195efef-5c76-4e62-ba08-c0d4a2cb6d3a None admin] RBAC: Adding query filter params (name=image) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:18.875185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195efef-5c76-4e62-ba08-c0d4a2cb6d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:18.876534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195efef-5c76-4e62-ba08-c0d4a2cb6d3a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:18.881528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 488/993] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:18.887181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4585ef2-4d0a-4326-8e46-83753e907a7b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:18.988878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4585ef2-4d0a-4326-8e46-83753e907a7b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:19.023209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddf28-68fd-42c8-8101-eed78bb28b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:19.023872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddf28-68fd-42c8-8101-eed78bb28b37 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:19.024152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddf28-68fd-42c8-8101-eed78bb28b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:19.024419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddf28-68fd-42c8-8101-eed78bb28b37 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:19.025188 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddf28-68fd-42c8-8101-eed78bb28b37 None admin] RBAC: Adding query filter params (type=image) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:19.025964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddf28-68fd-42c8-8101-eed78bb28b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:19.027212 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddf28-68fd-42c8-8101-eed78bb28b37 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:19.032066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 506/994] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:19.158396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325353-e669-4e89-9618-2dc9a4bbec91 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:19.158946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325353-e669-4e89-9618-2dc9a4bbec91 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:19.158946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325353-e669-4e89-9618-2dc9a4bbec91 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:19.160561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 489/995] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:19.166244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c22a91-b831-4717-852e-269f12bb59b9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:19.166560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c22a91-b831-4717-852e-269f12bb59b9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:19.166815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c22a91-b831-4717-852e-269f12bb59b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:19.184432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-64c22a91-b831-4717-852e-269f12bb59b9 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:19.185666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-64c22a91-b831-4717-852e-269f12bb59b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:19.252349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:19.264694 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 507/996] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:19.284892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd325353-e669-4e89-9618-2dc9a4bbec91 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:19.392897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd325353-e669-4e89-9618-2dc9a4bbec91 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:19.410372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:19.429093 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0ba5b-8e7d-493b-afe7-f01543bd0bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:19.429918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0ba5b-8e7d-493b-afe7-f01543bd0bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:19.430201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0ba5b-8e7d-493b-afe7-f01543bd0bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:19.430475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0ba5b-8e7d-493b-afe7-f01543bd0bc6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:19.431139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0ba5b-8e7d-493b-afe7-f01543bd0bc6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:19.432578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0ba5b-8e7d-493b-afe7-f01543bd0bc6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-b4c0ba5b-8e7d-493b-afe7-f01543bd0bc6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:19.444521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:19.445734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:06:19.446606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:19.448737 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 490/997] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:19.451741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c22a91-b831-4717-852e-269f12bb59b9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:19.555205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c22a91-b831-4717-852e-269f12bb59b9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:19.589732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b8fc-65ed-49fe-bbab-664f23d91652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:19.590398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b8fc-65ed-49fe-bbab-664f23d91652 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:19.590678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b8fc-65ed-49fe-bbab-664f23d91652 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:19.590949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b8fc-65ed-49fe-bbab-664f23d91652 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:19.591654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b8fc-65ed-49fe-bbab-664f23d91652 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:19.591952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b8fc-65ed-49fe-bbab-664f23d91652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:19.593335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b8fc-65ed-49fe-bbab-664f23d91652 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:19.598474 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 508/998] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:06:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:19.604176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0ba5b-8e7d-493b-afe7-f01543bd0bc6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:19.707200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0ba5b-8e7d-493b-afe7-f01543bd0bc6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:19.741272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75caad-307e-489b-8065-e126f10a0fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:19.741950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75caad-307e-489b-8065-e126f10a0fff None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:19.742237 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75caad-307e-489b-8065-e126f10a0fff None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:19.742515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75caad-307e-489b-8065-e126f10a0fff None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:19.743227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75caad-307e-489b-8065-e126f10a0fff None admin] RBAC: Adding query filter params (type=compute) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:19.743535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75caad-307e-489b-8065-e126f10a0fff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:19.745003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75caad-307e-489b-8065-e126f10a0fff None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:19.750197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 491/999] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:06:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:19.755684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b8fc-65ed-49fe-bbab-664f23d91652 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:19.819596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:19.863301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b8fc-65ed-49fe-bbab-664f23d91652 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:19.897804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec198b-3959-435a-aa3e-019c96b52ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:19.898518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec198b-3959-435a-aa3e-019c96b52ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:19.898786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec198b-3959-435a-aa3e-019c96b52ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:19.899059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec198b-3959-435a-aa3e-019c96b52ab5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:19.899849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec198b-3959-435a-aa3e-019c96b52ab5 None admin] RBAC: Adding query filter params (interface=public, service_id=b3ce31dad6af4abba7ec35006a424b48, region_id=RegionOne) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:19.900221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec198b-3959-435a-aa3e-019c96b52ab5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:19.901928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec198b-3959-435a-aa3e-019c96b52ab5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:19.907265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 509/1000] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jul 14 09:06:19 2022] GET /identity/v3/endpoints?service_id=b3ce31dad6af4abba7ec35006a424b48&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:19.912864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75caad-307e-489b-8065-e126f10a0fff None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:19.958588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:20.015253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75caad-307e-489b-8065-e126f10a0fff None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:20.050505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e6e0b-3333-4cc0-9d9d-efbca38c5f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:20.051163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e6e0b-3333-4cc0-9d9d-efbca38c5f01 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:20.051440 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e6e0b-3333-4cc0-9d9d-efbca38c5f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:20.051711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e6e0b-3333-4cc0-9d9d-efbca38c5f01 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:20.052418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e6e0b-3333-4cc0-9d9d-efbca38c5f01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:20.053794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e6e0b-3333-4cc0-9d9d-efbca38c5f01 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:20.060250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 492/1001] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jul 14 09:06:19 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:06:20.123214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f332-379e-4c65-a2dc-aff04868700e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:20.123435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f332-379e-4c65-a2dc-aff04868700e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:20.123667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f332-379e-4c65-a2dc-aff04868700e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:20.125524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 510/1002] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:20.131670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6397b9-3cd2-4cf0-8662-9e36ab0a225d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:20.131945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6397b9-3cd2-4cf0-8662-9e36ab0a225d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:20.132253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6397b9-3cd2-4cf0-8662-9e36ab0a225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:20.151220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-da6397b9-3cd2-4cf0-8662-9e36ab0a225d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:20.152414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-da6397b9-3cd2-4cf0-8662-9e36ab0a225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:20.230134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 493/1003] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:20.253381 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9f332-379e-4c65-a2dc-aff04868700e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:20.365883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9f332-379e-4c65-a2dc-aff04868700e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:20.394310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:20.408170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666809e5-4b10-49bd-b632-4d8140d9e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:20.409017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666809e5-4b10-49bd-b632-4d8140d9e242 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:20.409298 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666809e5-4b10-49bd-b632-4d8140d9e242 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:20.409569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666809e5-4b10-49bd-b632-4d8140d9e242 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:20.410240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666809e5-4b10-49bd-b632-4d8140d9e242 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:20.411610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666809e5-4b10-49bd-b632-4d8140d9e242 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-666809e5-4b10-49bd-b632-4d8140d9e242 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:20.423960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:20.425039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:20.431087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 511/1004] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jul 14 09:06:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:20.434226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6397b9-3cd2-4cf0-8662-9e36ab0a225d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:20.480407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:20.545484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6397b9-3cd2-4cf0-8662-9e36ab0a225d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:20.581113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9465a7d-1acf-440d-be38-51986eb7b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:20.581792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9465a7d-1acf-440d-be38-51986eb7b678 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:20.582037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9465a7d-1acf-440d-be38-51986eb7b678 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:20.582345 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9465a7d-1acf-440d-be38-51986eb7b678 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:20.583057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9465a7d-1acf-440d-be38-51986eb7b678 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:20.583361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9465a7d-1acf-440d-be38-51986eb7b678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:20.584711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9465a7d-1acf-440d-be38-51986eb7b678 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:20.590684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 494/1005] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jul 14 09:06:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:20.596395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666809e5-4b10-49bd-b632-4d8140d9e242 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:20.702693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666809e5-4b10-49bd-b632-4d8140d9e242 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:20.744685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a3c4e-f320-470b-abe9-86b6371c5b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:20.745381 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3c4e-f320-470b-abe9-86b6371c5b3d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:20.745663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3c4e-f320-470b-abe9-86b6371c5b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:20.745937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3c4e-f320-470b-abe9-86b6371c5b3d None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:20.746649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a3c4e-f320-470b-abe9-86b6371c5b3d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:20.746955 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a3c4e-f320-470b-abe9-86b6371c5b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:20.748327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a3c4e-f320-470b-abe9-86b6371c5b3d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:20.754064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 512/1006] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jul 14 09:06:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:20.760421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9465a7d-1acf-440d-be38-51986eb7b678 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:20.868563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9465a7d-1acf-440d-be38-51986eb7b678 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:20.870842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:20.906581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a5536-6eed-49bb-b2ac-45bbd31576a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:20.907249 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5536-6eed-49bb-b2ac-45bbd31576a6 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:20.907529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5536-6eed-49bb-b2ac-45bbd31576a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:20.907802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5536-6eed-49bb-b2ac-45bbd31576a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:20.908555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a5536-6eed-49bb-b2ac-45bbd31576a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:20.909957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a5536-6eed-49bb-b2ac-45bbd31576a6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:20.926080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 495/1007] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jul 14 09:06:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:21.060444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e0b15-5e0c-42ec-b444-3d9be9c4dc36 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:21.061009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e0b15-5e0c-42ec-b444-3d9be9c4dc36 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:21.061009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e0b15-5e0c-42ec-b444-3d9be9c4dc36 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:21.062541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 513/1008] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:21.068108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cf4bb-9e73-4848-b070-8c668000b2b2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:21.068450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cf4bb-9e73-4848-b070-8c668000b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:21.068646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cf4bb-9e73-4848-b070-8c668000b2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:21.089368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-840cf4bb-9e73-4848-b070-8c668000b2b2 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:21.090533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-840cf4bb-9e73-4848-b070-8c668000b2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:21.170670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 496/1009] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:21.192769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e0b15-5e0c-42ec-b444-3d9be9c4dc36 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:21.247448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:21.301058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e0b15-5e0c-42ec-b444-3d9be9c4dc36 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:21.335284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4427a-f817-41b9-88a8-04b558e3cb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:21.335864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4427a-f817-41b9-88a8-04b558e3cb6e None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:21.336141 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4427a-f817-41b9-88a8-04b558e3cb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:21.336406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4427a-f817-41b9-88a8-04b558e3cb6e None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:21.337251 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4427a-f817-41b9-88a8-04b558e3cb6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:21.338642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4427a-f817-41b9-88a8-04b558e3cb6e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:21.356699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 514/1010] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:06:21 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:22.074701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fac9c4-e66a-427e-b2e5-54a5f4774a4d None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:22.075278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fac9c4-e66a-427e-b2e5-54a5f4774a4d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:22.075278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fac9c4-e66a-427e-b2e5-54a5f4774a4d None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:22.076595 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 497/1011] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:22.082052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f398a-c82f-4f74-8407-91f915524f81 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:22.082498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f398a-c82f-4f74-8407-91f915524f81 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:22.082578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f398a-c82f-4f74-8407-91f915524f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:22.099964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7b7f398a-c82f-4f74-8407-91f915524f81 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:22.101167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7b7f398a-c82f-4f74-8407-91f915524f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:22.175761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 515/1012] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:22 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:22.198760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fac9c4-e66a-427e-b2e5-54a5f4774a4d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:22.295612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:22.310793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fac9c4-e66a-427e-b2e5-54a5f4774a4d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:22.346500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429d899-3f7b-4062-b2dd-0bc5bfcec9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:22.347228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429d899-3f7b-4062-b2dd-0bc5bfcec9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:22.347511 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429d899-3f7b-4062-b2dd-0bc5bfcec9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:22.347783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429d899-3f7b-4062-b2dd-0bc5bfcec9d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:22.348441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429d899-3f7b-4062-b2dd-0bc5bfcec9d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:22.349848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429d899-3f7b-4062-b2dd-0bc5bfcec9d9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3429d899-3f7b-4062-b2dd-0bc5bfcec9d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:22.364726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:22.365781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:22.366697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 498/1013] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:22.370330 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f398a-c82f-4f74-8407-91f915524f81 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:22.412082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:22.484822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f398a-c82f-4f74-8407-91f915524f81 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:22.520829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783b3d3-ec04-4b07-befb-7de661e142ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:22.521501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783b3d3-ec04-4b07-befb-7de661e142ae None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:22.521784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783b3d3-ec04-4b07-befb-7de661e142ae None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:22.522057 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783b3d3-ec04-4b07-befb-7de661e142ae None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:22.522746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783b3d3-ec04-4b07-befb-7de661e142ae None admin] RBAC: Adding query filter params (name=compute) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:22.523081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783b3d3-ec04-4b07-befb-7de661e142ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:22.524576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783b3d3-ec04-4b07-befb-7de661e142ae None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:22.530546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 516/1014] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:06:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:22.536080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429d899-3f7b-4062-b2dd-0bc5bfcec9d9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:22.643529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429d899-3f7b-4062-b2dd-0bc5bfcec9d9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:22.678515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4096b-3faf-4dd1-a4a0-a97c5aa8fb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:22.679197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4096b-3faf-4dd1-a4a0-a97c5aa8fb67 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:22.679485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4096b-3faf-4dd1-a4a0-a97c5aa8fb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:22.679760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4096b-3faf-4dd1-a4a0-a97c5aa8fb67 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:22.680478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4096b-3faf-4dd1-a4a0-a97c5aa8fb67 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:22.680933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4096b-3faf-4dd1-a4a0-a97c5aa8fb67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:22.682353 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4096b-3faf-4dd1-a4a0-a97c5aa8fb67 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:22.689192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 499/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jul 14 09:06:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:22.695283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783b3d3-ec04-4b07-befb-7de661e142ae None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:22.798429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:22.802237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783b3d3-ec04-4b07-befb-7de661e142ae None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:22.841666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f288e-fd12-451f-89c0-c445ef753fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:22.842445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f288e-fd12-451f-89c0-c445ef753fdc None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:22.842728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f288e-fd12-451f-89c0-c445ef753fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:22.843004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f288e-fd12-451f-89c0-c445ef753fdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:22.843757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f288e-fd12-451f-89c0-c445ef753fdc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:22.845170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f288e-fd12-451f-89c0-c445ef753fdc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:22.872710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 517/1016] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jul 14 09:06:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:22.953883 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50852c31-78a1-4199-8729-62b68c0eabda None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:22.954220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50852c31-78a1-4199-8729-62b68c0eabda None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:22.954489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50852c31-78a1-4199-8729-62b68c0eabda None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:22.955946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 500/1017] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:22.961867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cf489-9f36-4c80-b9d8-5cba75826933 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:22.962244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cf489-9f36-4c80-b9d8-5cba75826933 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:22.962691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cf489-9f36-4c80-b9d8-5cba75826933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:22.980991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-775cf489-9f36-4c80-b9d8-5cba75826933 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:22.982209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-775cf489-9f36-4c80-b9d8-5cba75826933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:23.066014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 518/1018] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:23.089424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50852c31-78a1-4199-8729-62b68c0eabda None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:23.110049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:23.205106 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50852c31-78a1-4199-8729-62b68c0eabda None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:23.241495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b031-40ca-477f-b3b8-e1f65b44744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:23.242316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b031-40ca-477f-b3b8-e1f65b44744c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:23.242601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b031-40ca-477f-b3b8-e1f65b44744c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:23.242898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b031-40ca-477f-b3b8-e1f65b44744c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:23.244125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b031-40ca-477f-b3b8-e1f65b44744c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:23.245591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b031-40ca-477f-b3b8-e1f65b44744c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:23.247485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 501/1019] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:23.253645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cf489-9f36-4c80-b9d8-5cba75826933 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:23.337401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:23.356775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cf489-9f36-4c80-b9d8-5cba75826933 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:23.394028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc730a45-b63d-4a96-bc69-48463dd6111b None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:23.394311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc730a45-b63d-4a96-bc69-48463dd6111b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:23.394423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07cf68-150a-409c-8956-3a41a9eeb475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:23.394650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc730a45-b63d-4a96-bc69-48463dd6111b None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:23.395136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07cf68-150a-409c-8956-3a41a9eeb475 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:23.395422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07cf68-150a-409c-8956-3a41a9eeb475 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:23.395699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07cf68-150a-409c-8956-3a41a9eeb475 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:23.396092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 502/1020] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:06:23.396433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07cf68-150a-409c-8956-3a41a9eeb475 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:23.397894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07cf68-150a-409c-8956-3a41a9eeb475 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:23.401741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7701a5-9c10-415f-aec2-5feddf85f42a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:23.402030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7701a5-9c10-415f-aec2-5feddf85f42a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:23.402305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7701a5-9c10-415f-aec2-5feddf85f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:23.419708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6c7701a5-9c10-415f-aec2-5feddf85f42a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:23.421242 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6c7701a5-9c10-415f-aec2-5feddf85f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:23.427900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 519/1021] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:06:23 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:23.500382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 503/1022] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:06:23.523943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07cf68-150a-409c-8956-3a41a9eeb475 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:23.637577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07cf68-150a-409c-8956-3a41a9eeb475 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:23.672202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb2a2f-a304-4a0c-9daa-f83177cac992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:23.673021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb2a2f-a304-4a0c-9daa-f83177cac992 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:23.673300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb2a2f-a304-4a0c-9daa-f83177cac992 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:23.673565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb2a2f-a304-4a0c-9daa-f83177cac992 None admin] PATH_INFO: `/v3/services/image` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:23.674213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb2a2f-a304-4a0c-9daa-f83177cac992 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:23.675586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb2a2f-a304-4a0c-9daa-f83177cac992 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:23.678462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d9eb2a2f-a304-4a0c-9daa-f83177cac992 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:23.688707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:23.689912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:23.696268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 520/1023] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Jul 14 09:06:23 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:23.701768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7701a5-9c10-415f-aec2-5feddf85f42a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:23.718184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:23.805077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7701a5-9c10-415f-aec2-5feddf85f42a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:23.839082 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366094f6-2a2b-4beb-a3b3-2062ec5d9058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:23.839744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366094f6-2a2b-4beb-a3b3-2062ec5d9058 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:23.840024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366094f6-2a2b-4beb-a3b3-2062ec5d9058 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:23.840295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366094f6-2a2b-4beb-a3b3-2062ec5d9058 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:23.841032 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366094f6-2a2b-4beb-a3b3-2062ec5d9058 None admin] RBAC: Adding query filter params (name=image) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:23.841334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366094f6-2a2b-4beb-a3b3-2062ec5d9058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:23.842716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366094f6-2a2b-4beb-a3b3-2062ec5d9058 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:23.847729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 504/1024] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:23.853292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb2a2f-a304-4a0c-9daa-f83177cac992 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:23.956022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb2a2f-a304-4a0c-9daa-f83177cac992 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:23.990859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10795-7693-409c-b3bf-a77e6ce40dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:23.991528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10795-7693-409c-b3bf-a77e6ce40dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:23.991804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10795-7693-409c-b3bf-a77e6ce40dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:23.992070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10795-7693-409c-b3bf-a77e6ce40dc6 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:23.992796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10795-7693-409c-b3bf-a77e6ce40dc6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:23.993129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10795-7693-409c-b3bf-a77e6ce40dc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:23.994478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10795-7693-409c-b3bf-a77e6ce40dc6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:23.999605 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 521/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:24.005401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366094f6-2a2b-4beb-a3b3-2062ec5d9058 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:24.083726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:24.108624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366094f6-2a2b-4beb-a3b3-2062ec5d9058 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:24.146178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1c453-f7ff-4af9-82bf-f0e09874c53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:24.146857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1c453-f7ff-4af9-82bf-f0e09874c53b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:24.147142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1c453-f7ff-4af9-82bf-f0e09874c53b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:24.147473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1c453-f7ff-4af9-82bf-f0e09874c53b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:24.148291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1c453-f7ff-4af9-82bf-f0e09874c53b None admin] RBAC: Adding query filter params (interface=public, service_id=55816ce194ad45cc96db7b9c115ccd34, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:24.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1c453-f7ff-4af9-82bf-f0e09874c53b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:24.150481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1c453-f7ff-4af9-82bf-f0e09874c53b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:24.157115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 505/1026] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jul 14 09:06:24 2022] GET /identity/v3/endpoints?service_id=55816ce194ad45cc96db7b9c115ccd34&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:24.162872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10795-7693-409c-b3bf-a77e6ce40dc6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:24.226566 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:24.267594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10795-7693-409c-b3bf-a77e6ce40dc6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:24.302578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc72bc5-c496-4c6f-bbc4-3c6be673436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:24.303229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc72bc5-c496-4c6f-bbc4-3c6be673436d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:24.303521 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc72bc5-c496-4c6f-bbc4-3c6be673436d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:24.303798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc72bc5-c496-4c6f-bbc4-3c6be673436d None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:24.304473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc72bc5-c496-4c6f-bbc4-3c6be673436d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:24.305882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc72bc5-c496-4c6f-bbc4-3c6be673436d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:24.312956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 522/1027] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jul 14 09:06:24 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:06:25.111087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199bbd-da7c-4a0b-885e-ec2420941c77 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:25.111619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199bbd-da7c-4a0b-885e-ec2420941c77 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:25.111619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199bbd-da7c-4a0b-885e-ec2420941c77 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:25.113083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 506/1028] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:25.118291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df25cc9-4cea-4ace-a951-0ca73483aae5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:25.118585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df25cc9-4cea-4ace-a951-0ca73483aae5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:25.118833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df25cc9-4cea-4ace-a951-0ca73483aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:25.138862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9df25cc9-4cea-4ace-a951-0ca73483aae5 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:25.140067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9df25cc9-4cea-4ace-a951-0ca73483aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:25.212607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 523/1029] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:06:25.236886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00199bbd-da7c-4a0b-885e-ec2420941c77 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:25.376007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00199bbd-da7c-4a0b-885e-ec2420941c77 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:25.414969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8d747-ce76-412e-b1ae-a57e968307ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:25.415806 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8d747-ce76-412e-b1ae-a57e968307ba None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:25.416107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8d747-ce76-412e-b1ae-a57e968307ba None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:25.416355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8d747-ce76-412e-b1ae-a57e968307ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:25.427812 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8d747-ce76-412e-b1ae-a57e968307ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-28c8d747-ce76-412e-b1ae-a57e968307ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:25.436057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:25.437044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:25.437921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:25.441033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 507/1030] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jul 14 09:06:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:25.443308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df25cc9-4cea-4ace-a951-0ca73483aae5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:25.493142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd6912-11ca-4a0c-b905-914da44a94bf None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:25.493469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd6912-11ca-4a0c-b905-914da44a94bf None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:25.493740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd6912-11ca-4a0c-b905-914da44a94bf None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:25.495276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 508/1031] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:25.500072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7679-96b3-4b3a-b1cb-2bd9edf75a73 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:25.500338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7679-96b3-4b3a-b1cb-2bd9edf75a73 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:25.500631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7679-96b3-4b3a-b1cb-2bd9edf75a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:25.503428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:25.506944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:25.520696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-698c7679-96b3-4b3a-b1cb-2bd9edf75a73 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:25.521894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-698c7679-96b3-4b3a-b1cb-2bd9edf75a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:25.552555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df25cc9-4cea-4ace-a951-0ca73483aae5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:25.587884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64202029-fb68-44cf-83b9-ec402faa73d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:25.588560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64202029-fb68-44cf-83b9-ec402faa73d2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:25.588869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64202029-fb68-44cf-83b9-ec402faa73d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:25.589143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64202029-fb68-44cf-83b9-ec402faa73d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:25.589888 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64202029-fb68-44cf-83b9-ec402faa73d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:25.590190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64202029-fb68-44cf-83b9-ec402faa73d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:25.597030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 509/1032] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:06:25.597179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64202029-fb68-44cf-83b9-ec402faa73d2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:25.599987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 524/1033] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jul 14 09:06:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:25.605540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7679-96b3-4b3a-b1cb-2bd9edf75a73 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:25.616133 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64202029-fb68-44cf-83b9-ec402faa73d2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:25.717738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7679-96b3-4b3a-b1cb-2bd9edf75a73 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:25.734836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64202029-fb68-44cf-83b9-ec402faa73d2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:25.747076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:25.752715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33733a4-2cee-4f94-8bda-06f20e483187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:25.753504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33733a4-2cee-4f94-8bda-06f20e483187 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:25.753784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33733a4-2cee-4f94-8bda-06f20e483187 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:25.754060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33733a4-2cee-4f94-8bda-06f20e483187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:25.757166 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:25.764793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33733a4-2cee-4f94-8bda-06f20e483187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:25.766245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33733a4-2cee-4f94-8bda-06f20e483187 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:25.777810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffcd6d-fa95-41c3-854d-94dc2a6d3ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:25.778797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffcd6d-fa95-41c3-854d-94dc2a6d3ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:25.779306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffcd6d-fa95-41c3-854d-94dc2a6d3ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:25.780349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffcd6d-fa95-41c3-854d-94dc2a6d3ea6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:25.781754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffcd6d-fa95-41c3-854d-94dc2a6d3ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:25.783314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffcd6d-fa95-41c3-854d-94dc2a6d3ea6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d33733a4-2cee-4f94-8bda-06f20e483187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:25.784301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:25.785379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:25.786399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:25.786399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:25.786399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:25.786399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:25.786399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 510/1034] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:25.787858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 525/1035] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:25.791131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33733a4-2cee-4f94-8bda-06f20e483187 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:25.793093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffcd6d-fa95-41c3-854d-94dc2a6d3ea6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:25.897522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33733a4-2cee-4f94-8bda-06f20e483187 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:25.904002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffcd6d-fa95-41c3-854d-94dc2a6d3ea6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:25.933740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bea1a-dc51-400c-9007-de1d9340adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:25.934421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bea1a-dc51-400c-9007-de1d9340adeb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:25.934707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bea1a-dc51-400c-9007-de1d9340adeb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:25.934984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bea1a-dc51-400c-9007-de1d9340adeb None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:25.935711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bea1a-dc51-400c-9007-de1d9340adeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:25.936075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bea1a-dc51-400c-9007-de1d9340adeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:25.937482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bea1a-dc51-400c-9007-de1d9340adeb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:25.942666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23f312-866a-4ef8-b3eb-75c55dcca1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:25.943340 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23f312-866a-4ef8-b3eb-75c55dcca1cc None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:25.943618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23f312-866a-4ef8-b3eb-75c55dcca1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:25.943891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23f312-866a-4ef8-b3eb-75c55dcca1cc None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:25.945126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23f312-866a-4ef8-b3eb-75c55dcca1cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:25.946983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23f312-866a-4ef8-b3eb-75c55dcca1cc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:25.949386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 511/1036] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:25.954855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bea1a-dc51-400c-9007-de1d9340adeb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:25.980773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 526/1037] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:06:25 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:26.017963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:26.083067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bea1a-dc51-400c-9007-de1d9340adeb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:26.121169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa401e-3729-4c3f-96bd-4f21e81052ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:26.121987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa401e-3729-4c3f-96bd-4f21e81052ba None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:26.122267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa401e-3729-4c3f-96bd-4f21e81052ba None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:26.122539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa401e-3729-4c3f-96bd-4f21e81052ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:26.131524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa401e-3729-4c3f-96bd-4f21e81052ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:26.133007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa401e-3729-4c3f-96bd-4f21e81052ba None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a8aa401e-3729-4c3f-96bd-4f21e81052ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:06:26.147613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:26.148611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:26.149687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 512/1038] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jul 14 09:06:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:26.155030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23f312-866a-4ef8-b3eb-75c55dcca1cc None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:26.203714 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:26.264454 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23f312-866a-4ef8-b3eb-75c55dcca1cc None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:26.300724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5262e67-af38-4154-9f79-4fff562e6ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:26.301385 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5262e67-af38-4154-9f79-4fff562e6ced None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:26.301670 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5262e67-af38-4154-9f79-4fff562e6ced None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:26.301941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5262e67-af38-4154-9f79-4fff562e6ced None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:26.302789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5262e67-af38-4154-9f79-4fff562e6ced None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:26.303098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5262e67-af38-4154-9f79-4fff562e6ced None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:26.304534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5262e67-af38-4154-9f79-4fff562e6ced None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:26.327097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 527/1039] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jul 14 09:06:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:26.328995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa401e-3729-4c3f-96bd-4f21e81052ba None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:26.351967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d61774-10c6-4b5a-858a-99f1f381f1f7 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:26.352222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d61774-10c6-4b5a-858a-99f1f381f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:26.352518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d61774-10c6-4b5a-858a-99f1f381f1f7 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:26.354108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 528/1040] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:06:26.359123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c417b4-362f-4670-9f48-adda791bdf9e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:26.359470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c417b4-362f-4670-9f48-adda791bdf9e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:26.359690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c417b4-362f-4670-9f48-adda791bdf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:26.378758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-10c417b4-362f-4670-9f48-adda791bdf9e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:26.379950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-10c417b4-362f-4670-9f48-adda791bdf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:26.444382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa401e-3729-4c3f-96bd-4f21e81052ba None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:26.447102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:26.453135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 529/1041] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:06:26.471562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c417b4-362f-4670-9f48-adda791bdf9e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:26.482532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1c66-a681-40d8-b58a-0f6d17812ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:26.483541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1c66-a681-40d8-b58a-0f6d17812ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:26.484013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1c66-a681-40d8-b58a-0f6d17812ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:26.484373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1c66-a681-40d8-b58a-0f6d17812ee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:26.501850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:26.558839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1c66-a681-40d8-b58a-0f6d17812ee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:26.560535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1c66-a681-40d8-b58a-0f6d17812ee2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:26.574962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c417b4-362f-4670-9f48-adda791bdf9e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:26.612321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aef113-7429-4ab4-841e-678699b37559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:26.613168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aef113-7429-4ab4-841e-678699b37559 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:26.613449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aef113-7429-4ab4-841e-678699b37559 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:26.613719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aef113-7429-4ab4-841e-678699b37559 None admin] PATH_INFO: `/v3/services/image` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:26.614384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aef113-7429-4ab4-841e-678699b37559 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:26.615761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aef113-7429-4ab4-841e-678699b37559 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-22aef113-7429-4ab4-841e-678699b37559 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:26.627733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:26.628815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:26.629867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 530/1042] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Jul 14 09:06:26 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:26.634952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aef113-7429-4ab4-841e-678699b37559 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:26.673459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 513/1043] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:26.679036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1c66-a681-40d8-b58a-0f6d17812ee2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:26.682794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:26.732583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:26.740954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aef113-7429-4ab4-841e-678699b37559 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:26.776033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f1074-7f7e-45b6-ad5f-ef04daa634f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:26.776730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1074-7f7e-45b6-ad5f-ef04daa634f6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:26.777019 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1074-7f7e-45b6-ad5f-ef04daa634f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:26.777326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1074-7f7e-45b6-ad5f-ef04daa634f6 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:26.778037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f1074-7f7e-45b6-ad5f-ef04daa634f6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:26.778320 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f1074-7f7e-45b6-ad5f-ef04daa634f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:26.779687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f1074-7f7e-45b6-ad5f-ef04daa634f6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:26.788724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 531/1044] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:26.790793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f1074-7f7e-45b6-ad5f-ef04daa634f6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:26.792970 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1c66-a681-40d8-b58a-0f6d17812ee2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:26.830721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc3a9c-eab7-4c21-bb02-e11ad936e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:26.831452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc3a9c-eab7-4c21-bb02-e11ad936e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:26.831740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc3a9c-eab7-4c21-bb02-e11ad936e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:26.832020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc3a9c-eab7-4c21-bb02-e11ad936e0f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:26.842583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc3a9c-eab7-4c21-bb02-e11ad936e0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:26.844031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc3a9c-eab7-4c21-bb02-e11ad936e0f9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-6fdc3a9c-eab7-4c21-bb02-e11ad936e0f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:26.862134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:26.863077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:26.864009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:26.864009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:26.864009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:26.864009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:26.864009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 514/1045] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:26.869094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc3a9c-eab7-4c21-bb02-e11ad936e0f9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:26.899877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f1074-7f7e-45b6-ad5f-ef04daa634f6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:26.928204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:26.938646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6358e-40af-4689-9673-31c56cc51ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:26.939313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6358e-40af-4689-9673-31c56cc51ecd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:26.939599 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6358e-40af-4689-9673-31c56cc51ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:26.939871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6358e-40af-4689-9673-31c56cc51ecd None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:26.940638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6358e-40af-4689-9673-31c56cc51ecd None admin] RBAC: Adding query filter params (type=image) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:26.940971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6358e-40af-4689-9673-31c56cc51ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:26.942377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6358e-40af-4689-9673-31c56cc51ecd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:26.948066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 532/1046] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:26.953543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6358e-40af-4689-9673-31c56cc51ecd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:26.977609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc3a9c-eab7-4c21-bb02-e11ad936e0f9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:26.978372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:27.013131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd85e2-b4d4-4842-824c-45e7aebc9a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:27.013800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd85e2-b4d4-4842-824c-45e7aebc9a63 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:27.014077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd85e2-b4d4-4842-824c-45e7aebc9a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:27.014347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd85e2-b4d4-4842-824c-45e7aebc9a63 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:27.015069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd85e2-b4d4-4842-824c-45e7aebc9a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:27.015370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd85e2-b4d4-4842-824c-45e7aebc9a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:27.016764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd85e2-b4d4-4842-824c-45e7aebc9a63 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:27.034267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 515/1047] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:27.035399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd85e2-b4d4-4842-824c-45e7aebc9a63 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:27.058278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6358e-40af-4689-9673-31c56cc51ecd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:27.092534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b68ae-d2b9-4779-9886-11edbe1c05d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:27.093116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b68ae-d2b9-4779-9886-11edbe1c05d1 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:27.093403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b68ae-d2b9-4779-9886-11edbe1c05d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:27.093682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b68ae-d2b9-4779-9886-11edbe1c05d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:27.094430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b68ae-d2b9-4779-9886-11edbe1c05d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:27.095876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b68ae-d2b9-4779-9886-11edbe1c05d1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:27.119138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 533/1048] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jul 14 09:06:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:27.150748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd85e2-b4d4-4842-824c-45e7aebc9a63 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:27.170498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:27.199490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd936df-7928-4dbf-9761-41dff1097317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:27.200315 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd936df-7928-4dbf-9761-41dff1097317 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:27.200604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd936df-7928-4dbf-9761-41dff1097317 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:27.200912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd936df-7928-4dbf-9761-41dff1097317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:27.208992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd936df-7928-4dbf-9761-41dff1097317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:27.210458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd936df-7928-4dbf-9761-41dff1097317 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-ffd936df-7928-4dbf-9761-41dff1097317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:06:27.226332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:27.227368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:27.228358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:06:27.228358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:06:27.228358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:06:27.228358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:06:27.228358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:06:27.228358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:06:27.228358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:27.228358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:27.228358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 516/1049] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:27.233588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b68ae-d2b9-4779-9886-11edbe1c05d1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:27.329382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:27.365222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b68ae-d2b9-4779-9886-11edbe1c05d1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:27.407660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42cda5-2d4c-4174-b23d-a57052e3230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:27.408332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42cda5-2d4c-4174-b23d-a57052e3230a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:27.409455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42cda5-2d4c-4174-b23d-a57052e3230a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:27.409455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42cda5-2d4c-4174-b23d-a57052e3230a None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:27.410106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42cda5-2d4c-4174-b23d-a57052e3230a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:27.410413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42cda5-2d4c-4174-b23d-a57052e3230a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:27.411951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42cda5-2d4c-4174-b23d-a57052e3230a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:27.426203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 534/1050] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:27.432121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd936df-7928-4dbf-9761-41dff1097317 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:27.555732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd936df-7928-4dbf-9761-41dff1097317 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:27.598843 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe5e2-0a43-473c-bd73-fc44c38d340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:27.603355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe5e2-0a43-473c-bd73-fc44c38d340e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:27.603607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe5e2-0a43-473c-bd73-fc44c38d340e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:27.603913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe5e2-0a43-473c-bd73-fc44c38d340e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:27.604895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbe5e2-0a43-473c-bd73-fc44c38d340e None admin] RBAC: Adding query filter params (role.id=234ada2bd8934cae8ffecb7e13fc8a96, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=66f1d95bcc534f4e945fc2c5be046a5f) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:27.605212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbe5e2-0a43-473c-bd73-fc44c38d340e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:27.606757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbe5e2-0a43-473c-bd73-fc44c38d340e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:27.613941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 517/1051] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:27 2022] GET /identity/v3/role_assignments?user.id=66f1d95bcc534f4e945fc2c5be046a5f&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=234ada2bd8934cae8ffecb7e13fc8a96 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:28.096038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f0da8-0e6b-472d-9f24-08d71ef3b911 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:28.096582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f0da8-0e6b-472d-9f24-08d71ef3b911 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:28.096582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f0da8-0e6b-472d-9f24-08d71ef3b911 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:28.098106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 535/1052] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:28.103889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32efe8-0d13-4bca-94fe-9f6c0eefec70 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:28.104142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32efe8-0d13-4bca-94fe-9f6c0eefec70 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:28.104430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32efe8-0d13-4bca-94fe-9f6c0eefec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:28.122289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-bc32efe8-0d13-4bca-94fe-9f6c0eefec70 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:28.123615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bc32efe8-0d13-4bca-94fe-9f6c0eefec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:28.160237 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:28.207189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 518/1053] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:28.230533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f0da8-0e6b-472d-9f24-08d71ef3b911 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:28.342260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f0da8-0e6b-472d-9f24-08d71ef3b911 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:28.384586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e0eb0-9bcc-46a2-bbdd-14f1685fc89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:28.385429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0eb0-9bcc-46a2-bbdd-14f1685fc89b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:28.385706 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0eb0-9bcc-46a2-bbdd-14f1685fc89b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:28.385975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0eb0-9bcc-46a2-bbdd-14f1685fc89b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:28.393164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:28.398283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e0eb0-9bcc-46a2-bbdd-14f1685fc89b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-467e0eb0-9bcc-46a2-bbdd-14f1685fc89b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:28.405835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:28.406804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:28.413674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 536/1054] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:06:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:28.414404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32efe8-0d13-4bca-94fe-9f6c0eefec70 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:28.513823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32efe8-0d13-4bca-94fe-9f6c0eefec70 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:28.548039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29acf8-10ec-4ae9-a0e0-32b0656ea7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:28.548726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29acf8-10ec-4ae9-a0e0-32b0656ea7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:28.549010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29acf8-10ec-4ae9-a0e0-32b0656ea7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:28.549282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29acf8-10ec-4ae9-a0e0-32b0656ea7c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:28.550026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29acf8-10ec-4ae9-a0e0-32b0656ea7c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:28.550334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29acf8-10ec-4ae9-a0e0-32b0656ea7c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:28.551700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29acf8-10ec-4ae9-a0e0-32b0656ea7c4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:28.564589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 519/1055] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:06:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:28.566229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e0eb0-9bcc-46a2-bbdd-14f1685fc89b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:28.677256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e0eb0-9bcc-46a2-bbdd-14f1685fc89b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:28.711516 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13944f8-3dfd-4b27-bad3-2386a92d6ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:28.712402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13944f8-3dfd-4b27-bad3-2386a92d6ebf None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:28.712688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13944f8-3dfd-4b27-bad3-2386a92d6ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:28.712991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13944f8-3dfd-4b27-bad3-2386a92d6ebf None admin] PATH_INFO: `/v3/users/0c755b52bb9849c68c123f7c39080874` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:28.727186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13944f8-3dfd-4b27-bad3-2386a92d6ebf None admin] RBAC: Authorizing `identity:get_user(user_id=0c755b52bb9849c68c123f7c39080874)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:28.728654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13944f8-3dfd-4b27-bad3-2386a92d6ebf None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:28.734960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 537/1056] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:28 2022] GET /identity/v3/users/0c755b52bb9849c68c123f7c39080874 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:28.736207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29acf8-10ec-4ae9-a0e0-32b0656ea7c4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:28.767380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:28.847200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29acf8-10ec-4ae9-a0e0-32b0656ea7c4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:28.883973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122139-e20e-47b8-99ba-4a6395899ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:28.884637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122139-e20e-47b8-99ba-4a6395899ede None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:28.884958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122139-e20e-47b8-99ba-4a6395899ede None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:28.885238 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122139-e20e-47b8-99ba-4a6395899ede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:28.956909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24122139-e20e-47b8-99ba-4a6395899ede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:28.958382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24122139-e20e-47b8-99ba-4a6395899ede None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:28.985916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:29.062639 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 520/1057] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:29.068347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13944f8-3dfd-4b27-bad3-2386a92d6ebf None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:29.128576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:29.176478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13944f8-3dfd-4b27-bad3-2386a92d6ebf None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:29.214893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb5418-56d5-45df-84a7-0810471aac1b None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:29.215432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb5418-56d5-45df-84a7-0810471aac1b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:29.215432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb5418-56d5-45df-84a7-0810471aac1b None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:29.216772 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 521/1058] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:29.218964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8987d-7d98-49bc-93aa-18e987c51f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:29.220041 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8987d-7d98-49bc-93aa-18e987c51f6a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:29.220490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8987d-7d98-49bc-93aa-18e987c51f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:29.220937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8987d-7d98-49bc-93aa-18e987c51f6a None admin] PATH_INFO: `/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:29.221621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a692a9-6016-4426-964b-9d7d33ce3ccc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:29.221905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a692a9-6016-4426-964b-9d7d33ce3ccc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:29.222181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a692a9-6016-4426-964b-9d7d33ce3ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:29.222725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8987d-7d98-49bc-93aa-18e987c51f6a None admin] RBAC: Authorizing `identity:get_project(project_id=e60dfe2e48464ef78f478e3bcab2dec9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:29.224409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8987d-7d98-49bc-93aa-18e987c51f6a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:29.231532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 538/1059] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:06:29 2022] GET /identity/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:29.232395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8987d-7d98-49bc-93aa-18e987c51f6a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:29.239995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d7a692a9-6016-4426-964b-9d7d33ce3ccc None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:29.241158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d7a692a9-6016-4426-964b-9d7d33ce3ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:29.312323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 522/1060] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:06:29.334431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a692a9-6016-4426-964b-9d7d33ce3ccc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:29.337774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8987d-7d98-49bc-93aa-18e987c51f6a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:29.367100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:29.381285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceca01-6696-4fbb-ab71-5d26096fd6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:29.381977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceca01-6696-4fbb-ab71-5d26096fd6fa None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:29.382299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceca01-6696-4fbb-ab71-5d26096fd6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:29.382558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceca01-6696-4fbb-ab71-5d26096fd6fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:29.383412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceca01-6696-4fbb-ab71-5d26096fd6fa None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=e60dfe2e48464ef78f478e3bcab2dec9, user.id=0c755b52bb9849c68c123f7c39080874) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:29.384108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceca01-6696-4fbb-ab71-5d26096fd6fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:29.385170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceca01-6696-4fbb-ab71-5d26096fd6fa None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:29.391284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 539/1061] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:29 2022] GET /identity/v3/role_assignments?user.id=0c755b52bb9849c68c123f7c39080874&scope.project.id=e60dfe2e48464ef78f478e3bcab2dec9&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:29.396424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:29.446547 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a692a9-6016-4426-964b-9d7d33ce3ccc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:29.485531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998448a-9066-4f2a-be10-9f33b79c4ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:29.486104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998448a-9066-4f2a-be10-9f33b79c4ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:29.486382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998448a-9066-4f2a-be10-9f33b79c4ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:29.486652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998448a-9066-4f2a-be10-9f33b79c4ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:29.564967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998448a-9066-4f2a-be10-9f33b79c4ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:29.566416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998448a-9066-4f2a-be10-9f33b79c4ac6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:29.626563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:29.675726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 523/1062] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 09:06:29.677144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceca01-6696-4fbb-ab71-5d26096fd6fa None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:29.768780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be31784-d29e-4b2b-91a8-2f87dc3d6ff8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:29.768975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be31784-d29e-4b2b-91a8-2f87dc3d6ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:29.769249 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be31784-d29e-4b2b-91a8-2f87dc3d6ff8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:29.771121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 524/1063] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:29.776737 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8942-dcfa-44a0-8898-ee976fbcdba7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:29.777033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8942-dcfa-44a0-8898-ee976fbcdba7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:29.777313 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8942-dcfa-44a0-8898-ee976fbcdba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:29.782168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceca01-6696-4fbb-ab71-5d26096fd6fa None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:29.795428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e49c8942-dcfa-44a0-8898-ee976fbcdba7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:29.796633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e49c8942-dcfa-44a0-8898-ee976fbcdba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:29.822594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2e748-da73-4a96-bc82-b353e3bae7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:29.823375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2e748-da73-4a96-bc82-b353e3bae7bb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:29.823681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2e748-da73-4a96-bc82-b353e3bae7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:29.823958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2e748-da73-4a96-bc82-b353e3bae7bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:29.835781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2e748-da73-4a96-bc82-b353e3bae7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:29.837535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2e748-da73-4a96-bc82-b353e3bae7bb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-3ed2e748-da73-4a96-bc82-b353e3bae7bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:29.857673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:29.858621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:29.859545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:29.859545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:29.859545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:29.859545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:29.859545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 540/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:29.864640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2e748-da73-4a96-bc82-b353e3bae7bb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:29.870403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 525/1065] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:29.892552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c8942-dcfa-44a0-8898-ee976fbcdba7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:29.909415 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:29.973661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2e748-da73-4a96-bc82-b353e3bae7bb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:29.986880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:30.001493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c8942-dcfa-44a0-8898-ee976fbcdba7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:30.014922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f4723-685c-4ee6-b9fd-2fa27f3d051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:30.015837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f4723-685c-4ee6-b9fd-2fa27f3d051b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:30.016126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f4723-685c-4ee6-b9fd-2fa27f3d051b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:30.016769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f4723-685c-4ee6-b9fd-2fa27f3d051b None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:30.017508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f4723-685c-4ee6-b9fd-2fa27f3d051b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:30.017820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f4723-685c-4ee6-b9fd-2fa27f3d051b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:30.019236 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f4723-685c-4ee6-b9fd-2fa27f3d051b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:30.030687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 541/1066] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:30.039352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe3084-887e-4d13-a237-af2c6ea0636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:30.040540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe3084-887e-4d13-a237-af2c6ea0636b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:30.041328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe3084-887e-4d13-a237-af2c6ea0636b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:30.041747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe3084-887e-4d13-a237-af2c6ea0636b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:30.054739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe3084-887e-4d13-a237-af2c6ea0636b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-0cfe3084-887e-4d13-a237-af2c6ea0636b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:30.063602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:30.064985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:30.065869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 526/1067] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jul 14 09:06:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:30.072386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f4723-685c-4ee6-b9fd-2fa27f3d051b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:30.185089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:30.189612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f4723-685c-4ee6-b9fd-2fa27f3d051b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:30.226665 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0df60-3c6f-4275-941f-61ee176895dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:30.227326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0df60-3c6f-4275-941f-61ee176895dd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:30.227600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0df60-3c6f-4275-941f-61ee176895dd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:30.227872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0df60-3c6f-4275-941f-61ee176895dd None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:30.228718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0df60-3c6f-4275-941f-61ee176895dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:30.229009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0df60-3c6f-4275-941f-61ee176895dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:30.230380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0df60-3c6f-4275-941f-61ee176895dd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:30.238987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 542/1068] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jul 14 09:06:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:30.245497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe3084-887e-4d13-a237-af2c6ea0636b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:30.354233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe3084-887e-4d13-a237-af2c6ea0636b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:30.389675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bd6a9-5a42-42d4-85a5-429d6e7fde8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:30.390481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bd6a9-5a42-42d4-85a5-429d6e7fde8d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:30.390761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bd6a9-5a42-42d4-85a5-429d6e7fde8d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:30.391040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bd6a9-5a42-42d4-85a5-429d6e7fde8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:30.403236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bd6a9-5a42-42d4-85a5-429d6e7fde8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:30.404794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bd6a9-5a42-42d4-85a5-429d6e7fde8d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:30.413276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-cf2bd6a9-5a42-42d4-85a5-429d6e7fde8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:30.424539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:30.425503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:30.431738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:30.431738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:30.431738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:30.431738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:30.431738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 527/1069] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:30.432551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0df60-3c6f-4275-941f-61ee176895dd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:30.538043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0df60-3c6f-4275-941f-61ee176895dd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:30.573447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf7f77-7e43-45e2-9e9a-a3b05dc451c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:30.574162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7f77-7e43-45e2-9e9a-a3b05dc451c8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:30.574451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7f77-7e43-45e2-9e9a-a3b05dc451c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:30.574712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7f77-7e43-45e2-9e9a-a3b05dc451c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:30.575459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf7f77-7e43-45e2-9e9a-a3b05dc451c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:30.575772 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf7f77-7e43-45e2-9e9a-a3b05dc451c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:30.577192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf7f77-7e43-45e2-9e9a-a3b05dc451c8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:30.589343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 543/1070] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:30.595314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bd6a9-5a42-42d4-85a5-429d6e7fde8d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:30.699714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bd6a9-5a42-42d4-85a5-429d6e7fde8d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:30.733645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b31cd-819b-4c92-8318-5545a1915c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:30.734429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b31cd-819b-4c92-8318-5545a1915c5f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:30.734707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b31cd-819b-4c92-8318-5545a1915c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:30.734978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b31cd-819b-4c92-8318-5545a1915c5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:30.742679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b31cd-819b-4c92-8318-5545a1915c5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:30.744112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b31cd-819b-4c92-8318-5545a1915c5f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-c64b31cd-819b-4c92-8318-5545a1915c5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:06:30.758139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:30.759144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:30.760544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 528/1071] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jul 14 09:06:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:30.765329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf7f77-7e43-45e2-9e9a-a3b05dc451c8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:30.790528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:30.868908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf7f77-7e43-45e2-9e9a-a3b05dc451c8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:30.904416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58234e6-256c-41c7-bb88-5ed6c77e8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:30.905110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58234e6-256c-41c7-bb88-5ed6c77e8db3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:30.905391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58234e6-256c-41c7-bb88-5ed6c77e8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:30.905664 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58234e6-256c-41c7-bb88-5ed6c77e8db3 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:30.906521 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58234e6-256c-41c7-bb88-5ed6c77e8db3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:30.906836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58234e6-256c-41c7-bb88-5ed6c77e8db3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:30.908292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58234e6-256c-41c7-bb88-5ed6c77e8db3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:30.926353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 544/1072] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jul 14 09:06:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:30.932217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b31cd-819b-4c92-8318-5545a1915c5f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:30.993060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:31.036139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b31cd-819b-4c92-8318-5545a1915c5f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:31.071354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0eb7d-7dd8-4189-a3d1-7491022d6941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:31.072146 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0eb7d-7dd8-4189-a3d1-7491022d6941 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:31.072423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0eb7d-7dd8-4189-a3d1-7491022d6941 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:31.072694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0eb7d-7dd8-4189-a3d1-7491022d6941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:31.083977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0eb7d-7dd8-4189-a3d1-7491022d6941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:31.085482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0eb7d-7dd8-4189-a3d1-7491022d6941 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a2b0eb7d-7dd8-4189-a3d1-7491022d6941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:31.102706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:31.103710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:31.104657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:31.104657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:31.104657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:31.104657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:31.104657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 529/1073] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:31.109896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58234e6-256c-41c7-bb88-5ed6c77e8db3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:31.194845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:31.215807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58234e6-256c-41c7-bb88-5ed6c77e8db3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:31.250558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cead9-9d0b-43f9-abe4-94be51016880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:31.251149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cead9-9d0b-43f9-abe4-94be51016880 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:31.251431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cead9-9d0b-43f9-abe4-94be51016880 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:31.251686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cead9-9d0b-43f9-abe4-94be51016880 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:31.252401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cead9-9d0b-43f9-abe4-94be51016880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:31.252729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cead9-9d0b-43f9-abe4-94be51016880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:31.254088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cead9-9d0b-43f9-abe4-94be51016880 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:31.266354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 545/1074] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:31.272456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0eb7d-7dd8-4189-a3d1-7491022d6941 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:31.373356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0eb7d-7dd8-4189-a3d1-7491022d6941 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:31.386611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:31.408992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8a768-818c-4d4d-b753-3f5edb455f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:31.409792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a768-818c-4d4d-b753-3f5edb455f39 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:31.410071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a768-818c-4d4d-b753-3f5edb455f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:31.410344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8a768-818c-4d4d-b753-3f5edb455f39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:31.417195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8a768-818c-4d4d-b753-3f5edb455f39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:31.418656 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8a768-818c-4d4d-b753-3f5edb455f39 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:31.430924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f629f2-af8d-4d29-ba17-0ee5386d9936 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:31.431213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f629f2-af8d-4d29-ba17-0ee5386d9936 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:31.431486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f629f2-af8d-4d29-ba17-0ee5386d9936 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:31.432890 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 546/1075] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-c8a8a768-818c-4d4d-b753-3f5edb455f39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:06:31.433100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:31.434558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:31.435481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:06:31.435481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:06:31.435481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:06:31.435481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:06:31.435481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:06:31.435481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:06:31.435481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:31.435481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:31.435481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 530/1076] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:31.438350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca84a3-6cb8-4bfa-9447-3bffb6717348 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:31.438637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca84a3-6cb8-4bfa-9447-3bffb6717348 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:31.438913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca84a3-6cb8-4bfa-9447-3bffb6717348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:31.440453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8a768-818c-4d4d-b753-3f5edb455f39 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:31.456788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-adca84a3-6cb8-4bfa-9447-3bffb6717348 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:31.457967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-adca84a3-6cb8-4bfa-9447-3bffb6717348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:31.524065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 547/1077] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:31.539673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8a768-818c-4d4d-b753-3f5edb455f39 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:31.547322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca84a3-6cb8-4bfa-9447-3bffb6717348 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:31.573965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de2af6-a338-4ed5-b16d-0d6ddb70af57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:31.574651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2af6-a338-4ed5-b16d-0d6ddb70af57 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:31.575136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2af6-a338-4ed5-b16d-0d6ddb70af57 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:31.575551 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2af6-a338-4ed5-b16d-0d6ddb70af57 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:31.576068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de2af6-a338-4ed5-b16d-0d6ddb70af57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:31.576368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de2af6-a338-4ed5-b16d-0d6ddb70af57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:31.577833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de2af6-a338-4ed5-b16d-0d6ddb70af57 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:31.589164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 531/1078] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:31.595410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de2af6-a338-4ed5-b16d-0d6ddb70af57 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:31.618354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:31.628031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:31.649320 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca84a3-6cb8-4bfa-9447-3bffb6717348 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:31.684322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97207f-6aae-49af-b938-c216078db006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:31.685199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97207f-6aae-49af-b938-c216078db006 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:31.685480 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97207f-6aae-49af-b938-c216078db006 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:31.685734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97207f-6aae-49af-b938-c216078db006 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:31.696324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97207f-6aae-49af-b938-c216078db006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:31.698490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de2af6-a338-4ed5-b16d-0d6ddb70af57 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5b97207f-6aae-49af-b938-c216078db006 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:31.704025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:31.705002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:31.705866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 548/1079] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:06:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:31.711373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97207f-6aae-49af-b938-c216078db006 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:31.733553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d76ee-c667-4776-b61d-4f7ca4c3e6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:31.734522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d76ee-c667-4776-b61d-4f7ca4c3e6fb None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:31.734806 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d76ee-c667-4776-b61d-4f7ca4c3e6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:31.735079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d76ee-c667-4776-b61d-4f7ca4c3e6fb None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/66f1d95bcc534f4e945fc2c5be046a5f/roles/234ada2bd8934cae8ffecb7e13fc8a96` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:31.737331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d76ee-c667-4776-b61d-4f7ca4c3e6fb None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=66f1d95bcc534f4e945fc2c5be046a5f, role_id=234ada2bd8934cae8ffecb7e13fc8a96)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:31.738757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d76ee-c667-4776-b61d-4f7ca4c3e6fb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:31.751879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 532/1080] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:06:31 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/66f1d95bcc534f4e945fc2c5be046a5f/roles/234ada2bd8934cae8ffecb7e13fc8a96 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:06:31.820188 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97207f-6aae-49af-b938-c216078db006 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:31.851700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:31.859300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4bf0-4e65-4675-861f-30043a585454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:31.859992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4bf0-4e65-4675-861f-30043a585454 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:31.860281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4bf0-4e65-4675-861f-30043a585454 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:31.860564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4bf0-4e65-4675-861f-30043a585454 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:31.861364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a4bf0-4e65-4675-861f-30043a585454 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:31.861682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a4bf0-4e65-4675-861f-30043a585454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:31.863082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a4bf0-4e65-4675-861f-30043a585454 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:31.873346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 549/1081] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:06:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:31.879450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d76ee-c667-4776-b61d-4f7ca4c3e6fb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:31.977054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:31.989885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d76ee-c667-4776-b61d-4f7ca4c3e6fb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:32.028440 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e93a9-e5ba-40be-a3a3-61b91fe28dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:32.029407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e93a9-e5ba-40be-a3a3-61b91fe28dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:32.029691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e93a9-e5ba-40be-a3a3-61b91fe28dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:32.029970 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e93a9-e5ba-40be-a3a3-61b91fe28dd8 None admin] PATH_INFO: `/v3/users/0c755b52bb9849c68c123f7c39080874` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:32.031241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e93a9-e5ba-40be-a3a3-61b91fe28dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=0c755b52bb9849c68c123f7c39080874)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:32.032748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e93a9-e5ba-40be-a3a3-61b91fe28dd8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:32.034416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 533/1082] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:31 2022] GET /identity/v3/users/0c755b52bb9849c68c123f7c39080874 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:32.040273 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4bf0-4e65-4675-861f-30043a585454 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:32.142025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4bf0-4e65-4675-861f-30043a585454 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:32.176874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d6e4f-4b38-44e4-a42b-08dffb39173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:32.177741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d6e4f-4b38-44e4-a42b-08dffb39173c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:32.178019 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d6e4f-4b38-44e4-a42b-08dffb39173c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:32.178290 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d6e4f-4b38-44e4-a42b-08dffb39173c None admin] PATH_INFO: `/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:32.179509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d6e4f-4b38-44e4-a42b-08dffb39173c None admin] RBAC: Authorizing `identity:get_project(project_id=e60dfe2e48464ef78f478e3bcab2dec9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:32.180978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d6e4f-4b38-44e4-a42b-08dffb39173c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:32.182670 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 550/1083] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:06:32 2022] GET /identity/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:32.188811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e93a9-e5ba-40be-a3a3-61b91fe28dd8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:32.293785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e93a9-e5ba-40be-a3a3-61b91fe28dd8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:32.330697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b1bc3-8637-440c-a76f-30312664920c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:32.331629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b1bc3-8637-440c-a76f-30312664920c None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:32.331916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b1bc3-8637-440c-a76f-30312664920c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:32.332193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b1bc3-8637-440c-a76f-30312664920c None admin] PATH_INFO: `/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9/users/0c755b52bb9849c68c123f7c39080874/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:32.334289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b1bc3-8637-440c-a76f-30312664920c None admin] RBAC: Authorizing `identity:create_grant(project_id=e60dfe2e48464ef78f478e3bcab2dec9, user_id=0c755b52bb9849c68c123f7c39080874, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:32.335733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b1bc3-8637-440c-a76f-30312664920c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:32.350105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 534/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:06:32 2022] PUT /identity/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9/users/0c755b52bb9849c68c123f7c39080874/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:06:33.753302 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cece5-e260-45e6-8ea2-3915d9dfb951 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:33.753856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cece5-e260-45e6-8ea2-3915d9dfb951 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:33.753856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cece5-e260-45e6-8ea2-3915d9dfb951 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:33.755387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 551/1085] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:33.760431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7af55-8874-4c92-be03-de2701fa5bcf None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:33.760905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7af55-8874-4c92-be03-de2701fa5bcf None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:33.761135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7af55-8874-4c92-be03-de2701fa5bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:33.779552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-05a7af55-8874-4c92-be03-de2701fa5bcf None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:33.780738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-05a7af55-8874-4c92-be03-de2701fa5bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:33.796366 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:33.853349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 535/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:33.876948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cece5-e260-45e6-8ea2-3915d9dfb951 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:33.940448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:33.984369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cece5-e260-45e6-8ea2-3915d9dfb951 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:34.020188 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45cda9-14ae-4160-9a55-d31b3f7846a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:34.020942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45cda9-14ae-4160-9a55-d31b3f7846a3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.021219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45cda9-14ae-4160-9a55-d31b3f7846a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.021487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45cda9-14ae-4160-9a55-d31b3f7846a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.032269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45cda9-14ae-4160-9a55-d31b3f7846a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2c45cda9-14ae-4160-9a55-d31b3f7846a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:34.040727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:34.041712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:34.047693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 552/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jul 14 09:06:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:34.050352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7af55-8874-4c92-be03-de2701fa5bcf None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:34.154254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7af55-8874-4c92-be03-de2701fa5bcf None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:34.188198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc847a2e-e540-4df1-b15c-edaa7efcc133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:34.188896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc847a2e-e540-4df1-b15c-edaa7efcc133 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.189184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc847a2e-e540-4df1-b15c-edaa7efcc133 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.189462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc847a2e-e540-4df1-b15c-edaa7efcc133 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.190269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc847a2e-e540-4df1-b15c-edaa7efcc133 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:34.190578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc847a2e-e540-4df1-b15c-edaa7efcc133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:34.191955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc847a2e-e540-4df1-b15c-edaa7efcc133 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:34.200236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 536/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jul 14 09:06:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:34.206136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45cda9-14ae-4160-9a55-d31b3f7846a3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:34.308170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45cda9-14ae-4160-9a55-d31b3f7846a3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:34.328512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:34.344166 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bca0f-88a9-407f-8bce-a8c9c6be4e76 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.344463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bca0f-88a9-407f-8bce-a8c9c6be4e76 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.344774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bca0f-88a9-407f-8bce-a8c9c6be4e76 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.345718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d9240-6a62-4c3c-a448-a7a108e32603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:34.346174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 537/1089] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:06:34.346550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9240-6a62-4c3c-a448-a7a108e32603 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.346931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9240-6a62-4c3c-a448-a7a108e32603 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.347210 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9240-6a62-4c3c-a448-a7a108e32603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.351231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab58d35-ec02-4c4d-92c5-06ff7c0fb92e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.351519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab58d35-ec02-4c4d-92c5-06ff7c0fb92e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.351805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab58d35-ec02-4c4d-92c5-06ff7c0fb92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.358367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d9240-6a62-4c3c-a448-a7a108e32603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:34.359816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d9240-6a62-4c3c-a448-a7a108e32603 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:34.370237 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-bab58d35-ec02-4c4d-92c5-06ff7c0fb92e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:34.371447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bab58d35-ec02-4c4d-92c5-06ff7c0fb92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-861d9240-6a62-4c3c-a448-a7a108e32603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:34.377823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:34.378940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:34.379885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:34.379885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:34.379885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:34.379885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:34.380107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:34.380179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 553/1090] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:34.385009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d9240-6a62-4c3c-a448-a7a108e32603 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:34.440869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 538/1091] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:06:34.464530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab58d35-ec02-4c4d-92c5-06ff7c0fb92e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:34.485464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d9240-6a62-4c3c-a448-a7a108e32603 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:34.519978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6f495-9e98-4f46-9411-5f90bd9adf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:34.520652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6f495-9e98-4f46-9411-5f90bd9adf51 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.520968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6f495-9e98-4f46-9411-5f90bd9adf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.521249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6f495-9e98-4f46-9411-5f90bd9adf51 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.521976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6f495-9e98-4f46-9411-5f90bd9adf51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:34.522282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6f495-9e98-4f46-9411-5f90bd9adf51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:34.523658 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6f495-9e98-4f46-9411-5f90bd9adf51 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:34.535757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 554/1092] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:34.541372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6f495-9e98-4f46-9411-5f90bd9adf51 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:34.567311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab58d35-ec02-4c4d-92c5-06ff7c0fb92e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:34.573900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:34.601040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a70da-98bc-45cf-b775-2a265e7c2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:34.601662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a70da-98bc-45cf-b775-2a265e7c2326 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.601937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a70da-98bc-45cf-b775-2a265e7c2326 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.602206 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a70da-98bc-45cf-b775-2a265e7c2326 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.612319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a70da-98bc-45cf-b775-2a265e7c2326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-036a70da-98bc-45cf-b775-2a265e7c2326 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:34.620498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:34.621578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:34.622800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 539/1093] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:06:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:06:34.627671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a70da-98bc-45cf-b775-2a265e7c2326 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:34.630683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:34.649264 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6f495-9e98-4f46-9411-5f90bd9adf51 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:34.683250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c482c0-1c80-4379-97db-c1228f59ed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:34.684058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c482c0-1c80-4379-97db-c1228f59ed21 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.684347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c482c0-1c80-4379-97db-c1228f59ed21 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.684627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c482c0-1c80-4379-97db-c1228f59ed21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.692211 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c482c0-1c80-4379-97db-c1228f59ed21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:34.693693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c482c0-1c80-4379-97db-c1228f59ed21 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-73c482c0-1c80-4379-97db-c1228f59ed21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:06:34.709989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:34.711111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:34.712064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 555/1094] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jul 14 09:06:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:34.716995 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c482c0-1c80-4379-97db-c1228f59ed21 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:34.730481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a70da-98bc-45cf-b775-2a265e7c2326 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:34.778278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e452aa-44b9-416b-a63c-9f4255cd4edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:34.779193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e452aa-44b9-416b-a63c-9f4255cd4edd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.779387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e452aa-44b9-416b-a63c-9f4255cd4edd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.779661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e452aa-44b9-416b-a63c-9f4255cd4edd None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.780418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e452aa-44b9-416b-a63c-9f4255cd4edd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:34.780748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e452aa-44b9-416b-a63c-9f4255cd4edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:34.782145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e452aa-44b9-416b-a63c-9f4255cd4edd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:34.793278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 540/1095] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:06:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:34.799915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e452aa-44b9-416b-a63c-9f4255cd4edd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:34.829768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:34.838854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c482c0-1c80-4379-97db-c1228f59ed21 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:34.867556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:34.875695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104146c6-fc8d-49d2-8cd9-42370d3151a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:34.876581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104146c6-fc8d-49d2-8cd9-42370d3151a6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.877023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104146c6-fc8d-49d2-8cd9-42370d3151a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.877630 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104146c6-fc8d-49d2-8cd9-42370d3151a6 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.879951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104146c6-fc8d-49d2-8cd9-42370d3151a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:34.880263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104146c6-fc8d-49d2-8cd9-42370d3151a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:34.882452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104146c6-fc8d-49d2-8cd9-42370d3151a6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:34.901410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 556/1096] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jul 14 09:06:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:34.908495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104146c6-fc8d-49d2-8cd9-42370d3151a6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:34.911723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e452aa-44b9-416b-a63c-9f4255cd4edd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:34.949927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd8e0b-8f32-4620-9955-780bea76cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:34.951137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd8e0b-8f32-4620-9955-780bea76cee9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:34.951432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd8e0b-8f32-4620-9955-780bea76cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:34.951707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd8e0b-8f32-4620-9955-780bea76cee9 None admin] PATH_INFO: `/v3/users/0c755b52bb9849c68c123f7c39080874` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:34.953080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd8e0b-8f32-4620-9955-780bea76cee9 None admin] RBAC: Authorizing `identity:get_user(user_id=0c755b52bb9849c68c123f7c39080874)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:34.954493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd8e0b-8f32-4620-9955-780bea76cee9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:34.956297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 541/1097] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:34 2022] GET /identity/v3/users/0c755b52bb9849c68c123f7c39080874 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:34.964961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd8e0b-8f32-4620-9955-780bea76cee9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:35.037050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104146c6-fc8d-49d2-8cd9-42370d3151a6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:35.072962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b7175-254e-40cf-aa27-085978483842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:35.073625 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b7175-254e-40cf-aa27-085978483842 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:35.073905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b7175-254e-40cf-aa27-085978483842 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:35.074179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b7175-254e-40cf-aa27-085978483842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:35.077419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd8e0b-8f32-4620-9955-780bea76cee9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:35.093151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:35.109252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:35.114886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16564c2-827f-4f7b-beca-631989bf0a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:35.115549 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16564c2-827f-4f7b-beca-631989bf0a6c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:35.115840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16564c2-827f-4f7b-beca-631989bf0a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:35.116119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16564c2-827f-4f7b-beca-631989bf0a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:35.146931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b7175-254e-40cf-aa27-085978483842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:35.148394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b7175-254e-40cf-aa27-085978483842 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:35.189343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16564c2-827f-4f7b-beca-631989bf0a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:35.190824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16564c2-827f-4f7b-beca-631989bf0a6c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:35.247861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 557/1098] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:35.253499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b7175-254e-40cf-aa27-085978483842 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:35.289763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 542/1099] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:35.295757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16564c2-827f-4f7b-beca-631989bf0a6c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:35.305885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:35.328076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:35.359077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b7175-254e-40cf-aa27-085978483842 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:35.397765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cb478-fa9c-4d61-aa49-5047d4fb9b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:35.398569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cb478-fa9c-4d61-aa49-5047d4fb9b72 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:35.398854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cb478-fa9c-4d61-aa49-5047d4fb9b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:35.399119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cb478-fa9c-4d61-aa49-5047d4fb9b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:35.401732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16564c2-827f-4f7b-beca-631989bf0a6c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:35.409296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cb478-fa9c-4d61-aa49-5047d4fb9b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:35.410733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cb478-fa9c-4d61-aa49-5047d4fb9b72 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-ef3cb478-fa9c-4d61-aa49-5047d4fb9b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:06:35.429154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:35.430224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:35.431343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:06:35.431343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:06:35.431343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:06:35.431343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:35.431343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 558/1100] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:35.436206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cb478-fa9c-4d61-aa49-5047d4fb9b72 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:35.440367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdffb4f-8bdf-497e-9c60-d839996e3742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:35.441272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdffb4f-8bdf-497e-9c60-d839996e3742 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:35.441560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdffb4f-8bdf-497e-9c60-d839996e3742 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:35.441836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdffb4f-8bdf-497e-9c60-d839996e3742 None admin] PATH_INFO: `/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:35.443151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdffb4f-8bdf-497e-9c60-d839996e3742 None admin] RBAC: Authorizing `identity:get_project(project_id=e60dfe2e48464ef78f478e3bcab2dec9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:35.444593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdffb4f-8bdf-497e-9c60-d839996e3742 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:35.446521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 543/1101] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:06:35 2022] GET /identity/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:35.452583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdffb4f-8bdf-497e-9c60-d839996e3742 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:35.535400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cb478-fa9c-4d61-aa49-5047d4fb9b72 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:35.537053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:35.549079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:35.552357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdffb4f-8bdf-497e-9c60-d839996e3742 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:35.571348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e28af-09ee-42f4-b245-e9988eec7a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:35.572011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e28af-09ee-42f4-b245-e9988eec7a9b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:35.572293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e28af-09ee-42f4-b245-e9988eec7a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:35.572565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e28af-09ee-42f4-b245-e9988eec7a9b None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:35.573307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e28af-09ee-42f4-b245-e9988eec7a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:35.573610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e28af-09ee-42f4-b245-e9988eec7a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:35.574960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e28af-09ee-42f4-b245-e9988eec7a9b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:35.586835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 559/1102] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:06:35.587878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d19a0-3cbe-4215-9a97-949a7c731655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:35.588604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d19a0-3cbe-4215-9a97-949a7c731655 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:35.588990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d19a0-3cbe-4215-9a97-949a7c731655 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:35.589273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d19a0-3cbe-4215-9a97-949a7c731655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:35.590112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d19a0-3cbe-4215-9a97-949a7c731655 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=e60dfe2e48464ef78f478e3bcab2dec9, user.id=0c755b52bb9849c68c123f7c39080874) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:35.590426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d19a0-3cbe-4215-9a97-949a7c731655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:35.592129 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d19a0-3cbe-4215-9a97-949a7c731655 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:35.592309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e28af-09ee-42f4-b245-e9988eec7a9b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:35.611507 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 544/1103] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:35 2022] GET /identity/v3/role_assignments?user.id=0c755b52bb9849c68c123f7c39080874&scope.project.id=e60dfe2e48464ef78f478e3bcab2dec9&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:35.703769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e28af-09ee-42f4-b245-e9988eec7a9b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:35.743055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc90e4-66e0-4b9b-aef4-16fcc49c20fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:35.743874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc90e4-66e0-4b9b-aef4-16fcc49c20fd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:35.744156 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc90e4-66e0-4b9b-aef4-16fcc49c20fd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:35.744426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc90e4-66e0-4b9b-aef4-16fcc49c20fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:35.752833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc90e4-66e0-4b9b-aef4-16fcc49c20fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:35.754261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc90e4-66e0-4b9b-aef4-16fcc49c20fd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-3abc90e4-66e0-4b9b-aef4-16fcc49c20fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:06:35.768828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:35.769785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:35.770692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:06:35.770692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:06:35.770692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:06:35.770692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:06:35.770692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:06:35.770692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:06:35.770692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:06:35.770692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:06:35.770692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 560/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:06:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:35.776056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d19a0-3cbe-4215-9a97-949a7c731655 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:35.876882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d19a0-3cbe-4215-9a97-949a7c731655 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:35.910463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0623d68-11ba-4f5d-9bac-690d304b690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:35.911120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0623d68-11ba-4f5d-9bac-690d304b690c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:35.911396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0623d68-11ba-4f5d-9bac-690d304b690c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:35.911669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0623d68-11ba-4f5d-9bac-690d304b690c None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:35.912528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0623d68-11ba-4f5d-9bac-690d304b690c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:35.912865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0623d68-11ba-4f5d-9bac-690d304b690c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:35.914286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0623d68-11ba-4f5d-9bac-690d304b690c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:35.927761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 545/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:06:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:35.934173 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc90e4-66e0-4b9b-aef4-16fcc49c20fd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:35.961081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:36.040031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc90e4-66e0-4b9b-aef4-16fcc49c20fd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:36.076457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37146c28-03eb-43fb-a66b-afbf7e712503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:36.077137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37146c28-03eb-43fb-a66b-afbf7e712503 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:36.077413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37146c28-03eb-43fb-a66b-afbf7e712503 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:36.077686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37146c28-03eb-43fb-a66b-afbf7e712503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:36.078536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37146c28-03eb-43fb-a66b-afbf7e712503 None admin] RBAC: Adding query filter params (role.id=234ada2bd8934cae8ffecb7e13fc8a96, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=66f1d95bcc534f4e945fc2c5be046a5f) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:36.078842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37146c28-03eb-43fb-a66b-afbf7e712503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:36.080266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37146c28-03eb-43fb-a66b-afbf7e712503 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:36.086669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 561/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:35 2022] GET /identity/v3/role_assignments?user.id=66f1d95bcc534f4e945fc2c5be046a5f&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=234ada2bd8934cae8ffecb7e13fc8a96 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:37.647278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500fc3c-aa1e-454f-8f18-0c31ad167435 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:37.648080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500fc3c-aa1e-454f-8f18-0c31ad167435 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:37.648080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500fc3c-aa1e-454f-8f18-0c31ad167435 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:37.650506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 546/1107] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:37.659044 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62465b-8c23-4efc-9249-2f3671afba9e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:37.659710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62465b-8c23-4efc-9249-2f3671afba9e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:37.659943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62465b-8c23-4efc-9249-2f3671afba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:37.686564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1f62465b-8c23-4efc-9249-2f3671afba9e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:37.687748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1f62465b-8c23-4efc-9249-2f3671afba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:37.763148 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 562/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:37.788397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500fc3c-aa1e-454f-8f18-0c31ad167435 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:37.818897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:37.901593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500fc3c-aa1e-454f-8f18-0c31ad167435 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:37.943813 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add0115-36f1-4cf8-9034-0135a815bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:37.944604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add0115-36f1-4cf8-9034-0135a815bc0c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:37.944910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add0115-36f1-4cf8-9034-0135a815bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:37.945182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add0115-36f1-4cf8-9034-0135a815bc0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:37.946494 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add0115-36f1-4cf8-9034-0135a815bc0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:37.947926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add0115-36f1-4cf8-9034-0135a815bc0c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:37.949650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 547/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:37.955486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62465b-8c23-4efc-9249-2f3671afba9e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:37.976322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:38.072479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62465b-8c23-4efc-9249-2f3671afba9e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:38.114901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68212aa-3509-4f14-995e-693b0e6e3ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:38.115937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68212aa-3509-4f14-995e-693b0e6e3ff7 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:38.116369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68212aa-3509-4f14-995e-693b0e6e3ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:38.116836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68212aa-3509-4f14-995e-693b0e6e3ff7 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:38.117993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68212aa-3509-4f14-995e-693b0e6e3ff7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:38.120212 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68212aa-3509-4f14-995e-693b0e6e3ff7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:38.148138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 563/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:06:37 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:40.212417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe674-e7ac-4fa6-af9a-be8d0f2a1e61 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:40.213036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe674-e7ac-4fa6-af9a-be8d0f2a1e61 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:40.213036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe674-e7ac-4fa6-af9a-be8d0f2a1e61 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:40.214394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 548/1111] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:40.221119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bee359-8f0f-4c1b-b452-3fe1c4fa4a20 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:40.221830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bee359-8f0f-4c1b-b452-3fe1c4fa4a20 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:40.221969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bee359-8f0f-4c1b-b452-3fe1c4fa4a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:40.250516 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-65bee359-8f0f-4c1b-b452-3fe1c4fa4a20 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:40.251713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-65bee359-8f0f-4c1b-b452-3fe1c4fa4a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:40.323278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 564/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:40.348779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbe674-e7ac-4fa6-af9a-be8d0f2a1e61 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:40.449337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:40.460393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbe674-e7ac-4fa6-af9a-be8d0f2a1e61 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:40.496053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8e994-4f8f-475d-8fdc-f73b8de163cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:40.496898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8e994-4f8f-475d-8fdc-f73b8de163cd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:40.497182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8e994-4f8f-475d-8fdc-f73b8de163cd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:40.497453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8e994-4f8f-475d-8fdc-f73b8de163cd None admin] PATH_INFO: `/v3/roles/45788771d2f1494a801cc09d365ff9e2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:40.498963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8e994-4f8f-475d-8fdc-f73b8de163cd None admin] RBAC: Authorizing `identity:get_role(role_id=45788771d2f1494a801cc09d365ff9e2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:40.500325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8e994-4f8f-475d-8fdc-f73b8de163cd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:40.501747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 549/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:40 2022] GET /identity/v3/roles/45788771d2f1494a801cc09d365ff9e2 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:40.507926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bee359-8f0f-4c1b-b452-3fe1c4fa4a20 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:40.510191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:40.615250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bee359-8f0f-4c1b-b452-3fe1c4fa4a20 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:40.652503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce94870-5def-4e7f-a225-928421f5a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:40.653412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce94870-5def-4e7f-a225-928421f5a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:40.653694 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce94870-5def-4e7f-a225-928421f5a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:40.653964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce94870-5def-4e7f-a225-928421f5a1e5 None admin] PATH_INFO: `/v3/users/c4d2cd3f9e0548d9b5ffea18ceb6acf8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:40.667991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce94870-5def-4e7f-a225-928421f5a1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d2cd3f9e0548d9b5ffea18ceb6acf8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:40.669468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce94870-5def-4e7f-a225-928421f5a1e5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:40.671109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 565/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:40 2022] GET /identity/v3/users/c4d2cd3f9e0548d9b5ffea18ceb6acf8 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:40.681129 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8e994-4f8f-475d-8fdc-f73b8de163cd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:40.797235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8e994-4f8f-475d-8fdc-f73b8de163cd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:40.834382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a20b1-8daa-4174-9698-838da5ff2adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:40.835017 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a20b1-8daa-4174-9698-838da5ff2adc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:40.835299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a20b1-8daa-4174-9698-838da5ff2adc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:40.835573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a20b1-8daa-4174-9698-838da5ff2adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:40.864455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:40.908024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a20b1-8daa-4174-9698-838da5ff2adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:40.909645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a20b1-8daa-4174-9698-838da5ff2adc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:41.017084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 550/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:41.023997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce94870-5def-4e7f-a225-928421f5a1e5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:41.096808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:41.143893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce94870-5def-4e7f-a225-928421f5a1e5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:41.179406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c89f0-6edd-48ce-8fbd-d8dafe6a1dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:41.180268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c89f0-6edd-48ce-8fbd-d8dafe6a1dfc None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:41.180545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c89f0-6edd-48ce-8fbd-d8dafe6a1dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:41.180846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c89f0-6edd-48ce-8fbd-d8dafe6a1dfc None admin] PATH_INFO: `/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:41.182136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c89f0-6edd-48ce-8fbd-d8dafe6a1dfc None admin] RBAC: Authorizing `identity:get_project(project_id=e60dfe2e48464ef78f478e3bcab2dec9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:41.183567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c89f0-6edd-48ce-8fbd-d8dafe6a1dfc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:41.185283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 566/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:06:41 2022] GET /identity/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:41.195911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a20b1-8daa-4174-9698-838da5ff2adc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:41.263207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:41.307690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a20b1-8daa-4174-9698-838da5ff2adc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:41.345854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaa159-6970-411a-a31b-8f038021ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:41.346516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaa159-6970-411a-a31b-8f038021ce47 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:41.346793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaa159-6970-411a-a31b-8f038021ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:41.347118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaa159-6970-411a-a31b-8f038021ce47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:41.347895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aaa159-6970-411a-a31b-8f038021ce47 None admin] RBAC: Adding query filter params (role.id=45788771d2f1494a801cc09d365ff9e2, scope.project.id=e60dfe2e48464ef78f478e3bcab2dec9, user.id=c4d2cd3f9e0548d9b5ffea18ceb6acf8) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:41.348197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aaa159-6970-411a-a31b-8f038021ce47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:41.349647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aaa159-6970-411a-a31b-8f038021ce47 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:41.355039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 551/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:41 2022] GET /identity/v3/role_assignments?user.id=c4d2cd3f9e0548d9b5ffea18ceb6acf8&scope.project.id=e60dfe2e48464ef78f478e3bcab2dec9&role.id=45788771d2f1494a801cc09d365ff9e2 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:43.342424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe69e7-5b62-40be-bb3f-79666e4481f6 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:43.343368 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe69e7-5b62-40be-bb3f-79666e4481f6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:43.343368 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe69e7-5b62-40be-bb3f-79666e4481f6 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:43.345532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 567/1118] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:43.354400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94c508-71fc-4201-b413-45fdd51cc2ff None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:43.354837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94c508-71fc-4201-b413-45fdd51cc2ff None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:43.354973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94c508-71fc-4201-b413-45fdd51cc2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:43.376540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ce94c508-71fc-4201-b413-45fdd51cc2ff None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:43.377783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ce94c508-71fc-4201-b413-45fdd51cc2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:43.451605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 552/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:43.475301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe69e7-5b62-40be-bb3f-79666e4481f6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:43.584560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe69e7-5b62-40be-bb3f-79666e4481f6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:43.611617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:43.621357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1198b-9b13-422a-a744-c50cfa24684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:43.622215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1198b-9b13-422a-a744-c50cfa24684f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:43.622496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1198b-9b13-422a-a744-c50cfa24684f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:43.622769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1198b-9b13-422a-a744-c50cfa24684f None admin] PATH_INFO: `/v3/roles/45788771d2f1494a801cc09d365ff9e2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:43.624277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1198b-9b13-422a-a744-c50cfa24684f None admin] RBAC: Authorizing `identity:get_role(role_id=45788771d2f1494a801cc09d365ff9e2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:43.625675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1198b-9b13-422a-a744-c50cfa24684f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:43.627041 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 568/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:43 2022] GET /identity/v3/roles/45788771d2f1494a801cc09d365ff9e2 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:43.633942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94c508-71fc-4201-b413-45fdd51cc2ff None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:43.692257 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:43.745605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94c508-71fc-4201-b413-45fdd51cc2ff None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:43.785369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5291c30-ca27-4bba-a782-4c42e3293326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:43.786329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5291c30-ca27-4bba-a782-4c42e3293326 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:43.786613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5291c30-ca27-4bba-a782-4c42e3293326 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:43.786888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5291c30-ca27-4bba-a782-4c42e3293326 None admin] PATH_INFO: `/v3/users/c4d2cd3f9e0548d9b5ffea18ceb6acf8` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:43.788216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5291c30-ca27-4bba-a782-4c42e3293326 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d2cd3f9e0548d9b5ffea18ceb6acf8)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:43.789696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5291c30-ca27-4bba-a782-4c42e3293326 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:43.791341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 553/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:43 2022] GET /identity/v3/users/c4d2cd3f9e0548d9b5ffea18ceb6acf8 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:43.797650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1198b-9b13-422a-a744-c50cfa24684f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:43.905816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1198b-9b13-422a-a744-c50cfa24684f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:43.940418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3d208-07d6-4e1b-9e86-305406af48d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:43.941296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d208-07d6-4e1b-9e86-305406af48d3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:43.941572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d208-07d6-4e1b-9e86-305406af48d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:43.941842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d208-07d6-4e1b-9e86-305406af48d3 None admin] PATH_INFO: `/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:43.943109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3d208-07d6-4e1b-9e86-305406af48d3 None admin] RBAC: Authorizing `identity:get_project(project_id=e60dfe2e48464ef78f478e3bcab2dec9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:43.944879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3d208-07d6-4e1b-9e86-305406af48d3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:43.946548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 569/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:06:43 2022] GET /identity/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:43.955845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5291c30-ca27-4bba-a782-4c42e3293326 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:44.065747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5291c30-ca27-4bba-a782-4c42e3293326 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:44.089278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:44.103181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780cde8-5957-41c8-b8e0-ec06737b7e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:44.104075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780cde8-5957-41c8-b8e0-ec06737b7e19 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:44.104355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780cde8-5957-41c8-b8e0-ec06737b7e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:44.104631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780cde8-5957-41c8-b8e0-ec06737b7e19 None admin] PATH_INFO: `/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9/users/c4d2cd3f9e0548d9b5ffea18ceb6acf8/roles/45788771d2f1494a801cc09d365ff9e2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:44.107264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780cde8-5957-41c8-b8e0-ec06737b7e19 None admin] RBAC: Authorizing `identity:create_grant(project_id=e60dfe2e48464ef78f478e3bcab2dec9, user_id=c4d2cd3f9e0548d9b5ffea18ceb6acf8, role_id=45788771d2f1494a801cc09d365ff9e2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:44.108706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780cde8-5957-41c8-b8e0-ec06737b7e19 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:44.123423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 554/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:06:43 2022] PUT /identity/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9/users/c4d2cd3f9e0548d9b5ffea18ceb6acf8/roles/45788771d2f1494a801cc09d365ff9e2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:06:46.085227 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ec93-2ab5-461e-825c-2502bef690d9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:46.085784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ec93-2ab5-461e-825c-2502bef690d9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:46.085784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ec93-2ab5-461e-825c-2502bef690d9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:46.087172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 570/1124] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:46.096459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27f622-d692-40a1-af7b-439205a9f904 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:46.097252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27f622-d692-40a1-af7b-439205a9f904 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:46.097408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27f622-d692-40a1-af7b-439205a9f904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:46.119336 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9b27f622-d692-40a1-af7b-439205a9f904 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:46.120532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9b27f622-d692-40a1-af7b-439205a9f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:46.193920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 555/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:46.218928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201ec93-2ab5-461e-825c-2502bef690d9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:46.290143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:46.338355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201ec93-2ab5-461e-825c-2502bef690d9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:46.373965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0ba2b-046a-48b5-845d-958173674dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:46.374826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ba2b-046a-48b5-845d-958173674dbe None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:46.375062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ba2b-046a-48b5-845d-958173674dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:46.375367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ba2b-046a-48b5-845d-958173674dbe None admin] PATH_INFO: `/v3/roles/45788771d2f1494a801cc09d365ff9e2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:46.377353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0ba2b-046a-48b5-845d-958173674dbe None admin] RBAC: Authorizing `identity:get_role(role_id=45788771d2f1494a801cc09d365ff9e2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:46.378249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0ba2b-046a-48b5-845d-958173674dbe None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:46.379620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 571/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:46 2022] GET /identity/v3/roles/45788771d2f1494a801cc09d365ff9e2 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:46.385861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27f622-d692-40a1-af7b-439205a9f904 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:46.490336 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27f622-d692-40a1-af7b-439205a9f904 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:46.503700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:46.535527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30fd2c-e378-485c-84eb-817a0790ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:46.536402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30fd2c-e378-485c-84eb-817a0790ba81 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:46.536707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30fd2c-e378-485c-84eb-817a0790ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:46.536984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30fd2c-e378-485c-84eb-817a0790ba81 None admin] PATH_INFO: `/v3/users/c4d2cd3f9e0548d9b5ffea18ceb6acf8` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:46.538263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30fd2c-e378-485c-84eb-817a0790ba81 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d2cd3f9e0548d9b5ffea18ceb6acf8)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:46.539728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30fd2c-e378-485c-84eb-817a0790ba81 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:46.541411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 556/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:46 2022] GET /identity/v3/users/c4d2cd3f9e0548d9b5ffea18ceb6acf8 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:46.547402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0ba2b-046a-48b5-845d-958173674dbe None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:46.659775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0ba2b-046a-48b5-845d-958173674dbe None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:46.692737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:46.699928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344cc0-0fe9-4b26-9c8d-c3d3df3f6eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:46.700570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344cc0-0fe9-4b26-9c8d-c3d3df3f6eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:46.700884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344cc0-0fe9-4b26-9c8d-c3d3df3f6eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:46.701162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344cc0-0fe9-4b26-9c8d-c3d3df3f6eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:46.770994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a344cc0-0fe9-4b26-9c8d-c3d3df3f6eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:46.772429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a344cc0-0fe9-4b26-9c8d-c3d3df3f6eb5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:46.875953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 572/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:46.882912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30fd2c-e378-485c-84eb-817a0790ba81 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:47.001130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30fd2c-e378-485c-84eb-817a0790ba81 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:47.036717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2559c7-a9ce-4679-8398-31b2c7b7e9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:47.037605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2559c7-a9ce-4679-8398-31b2c7b7e9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:47.037893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2559c7-a9ce-4679-8398-31b2c7b7e9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:47.038162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2559c7-a9ce-4679-8398-31b2c7b7e9b2 None admin] PATH_INFO: `/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:47.039465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2559c7-a9ce-4679-8398-31b2c7b7e9b2 None admin] RBAC: Authorizing `identity:get_project(project_id=e60dfe2e48464ef78f478e3bcab2dec9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:47.040920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2559c7-a9ce-4679-8398-31b2c7b7e9b2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:47.042769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 557/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:06:46 2022] GET /identity/v3/projects/e60dfe2e48464ef78f478e3bcab2dec9 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:47.052717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344cc0-0fe9-4b26-9c8d-c3d3df3f6eb5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:47.088170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:47.165534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344cc0-0fe9-4b26-9c8d-c3d3df3f6eb5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:47.203980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd80b97-f062-41bf-82a6-e2cad4bb1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:47.204638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80b97-f062-41bf-82a6-e2cad4bb1131 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:47.204958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80b97-f062-41bf-82a6-e2cad4bb1131 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:47.205228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80b97-f062-41bf-82a6-e2cad4bb1131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:47.206061 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd80b97-f062-41bf-82a6-e2cad4bb1131 None admin] RBAC: Adding query filter params (role.id=45788771d2f1494a801cc09d365ff9e2, scope.project.id=e60dfe2e48464ef78f478e3bcab2dec9, user.id=c4d2cd3f9e0548d9b5ffea18ceb6acf8) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:47.206374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd80b97-f062-41bf-82a6-e2cad4bb1131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:47.207816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd80b97-f062-41bf-82a6-e2cad4bb1131 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:47.213922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 573/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:47 2022] GET /identity/v3/role_assignments?user.id=c4d2cd3f9e0548d9b5ffea18ceb6acf8&scope.project.id=e60dfe2e48464ef78f478e3bcab2dec9&role.id=45788771d2f1494a801cc09d365ff9e2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:49.200363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c8fa1-2f0a-441b-b672-745e44d6ef23 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:49.201376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c8fa1-2f0a-441b-b672-745e44d6ef23 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:49.201478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c8fa1-2f0a-441b-b672-745e44d6ef23 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:49.202833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 558/1131] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:49.209102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03128f8-0dfd-479b-bf57-a643af7e0a17 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:49.209839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03128f8-0dfd-479b-bf57-a643af7e0a17 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:49.209977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03128f8-0dfd-479b-bf57-a643af7e0a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:49.236339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d03128f8-0dfd-479b-bf57-a643af7e0a17 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:49.237567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d03128f8-0dfd-479b-bf57-a643af7e0a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:49.317956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 574/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:49.341287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c8fa1-2f0a-441b-b672-745e44d6ef23 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:49.399209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:49.449608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c8fa1-2f0a-441b-b672-745e44d6ef23 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:49.485068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00beec2-a356-4b54-aaff-6603b23c513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:49.485858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00beec2-a356-4b54-aaff-6603b23c513b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:49.486136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00beec2-a356-4b54-aaff-6603b23c513b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:49.486407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00beec2-a356-4b54-aaff-6603b23c513b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:49.487636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00beec2-a356-4b54-aaff-6603b23c513b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:49.489099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00beec2-a356-4b54-aaff-6603b23c513b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:49.490702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 559/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:49.497614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03128f8-0dfd-479b-bf57-a643af7e0a17 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:49.525991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:49.599726 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03128f8-0dfd-479b-bf57-a643af7e0a17 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:49.635506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489735f0-e33e-4bbe-bc12-16f2b5401110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:49.636154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489735f0-e33e-4bbe-bc12-16f2b5401110 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:49.636432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489735f0-e33e-4bbe-bc12-16f2b5401110 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:49.636709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489735f0-e33e-4bbe-bc12-16f2b5401110 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:49.637432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489735f0-e33e-4bbe-bc12-16f2b5401110 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:49.638989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489735f0-e33e-4bbe-bc12-16f2b5401110 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:49.671914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 575/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:06:49 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:51.691797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ee88-486e-465e-afbf-9097efd44a40 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:51.692334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ee88-486e-465e-afbf-9097efd44a40 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:51.692334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ee88-486e-465e-afbf-9097efd44a40 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:51.693690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 560/1135] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:51.699977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27b8ad-66dd-4893-87da-d8b0a10dc966 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:51.700732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27b8ad-66dd-4893-87da-d8b0a10dc966 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:51.700901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27b8ad-66dd-4893-87da-d8b0a10dc966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:51.726449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8e27b8ad-66dd-4893-87da-d8b0a10dc966 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:51.727639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8e27b8ad-66dd-4893-87da-d8b0a10dc966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:51.799089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 576/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:51.829718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ee88-486e-465e-afbf-9097efd44a40 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:51.939133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ee88-486e-465e-afbf-9097efd44a40 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:51.956546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:51.976638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0789f-fd4e-421c-8ac8-ef8b0dd75d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:51.977452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0789f-fd4e-421c-8ac8-ef8b0dd75d0b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:51.977733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0789f-fd4e-421c-8ac8-ef8b0dd75d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:51.978034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0789f-fd4e-421c-8ac8-ef8b0dd75d0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:51.979320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0789f-fd4e-421c-8ac8-ef8b0dd75d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:51.980781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0789f-fd4e-421c-8ac8-ef8b0dd75d0b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:51.982476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 561/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:06:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:51.988545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27b8ad-66dd-4893-87da-d8b0a10dc966 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:51.999137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:52.091662 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27b8ad-66dd-4893-87da-d8b0a10dc966 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:52.128315 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000b17c-8cab-43c0-b4fc-c0befea9ae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:52.129012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b17c-8cab-43c0-b4fc-c0befea9ae7d None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:52.129288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b17c-8cab-43c0-b4fc-c0befea9ae7d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:52.129559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000b17c-8cab-43c0-b4fc-c0befea9ae7d None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:52.130263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000b17c-8cab-43c0-b4fc-c0befea9ae7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:52.131675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000b17c-8cab-43c0-b4fc-c0befea9ae7d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:52.157159 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 577/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:06:51 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:06:54.193567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9d160-fac7-483e-856a-3f9e3c92dfad None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:54.194163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9d160-fac7-483e-856a-3f9e3c92dfad None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:54.194163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9d160-fac7-483e-856a-3f9e3c92dfad None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:54.195508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 562/1139] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:54.202042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c520c-451d-4dd0-8178-1afe87ccd2e9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:54.202775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c520c-451d-4dd0-8178-1afe87ccd2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:54.202928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c520c-451d-4dd0-8178-1afe87ccd2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:54.223528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0d7c520c-451d-4dd0-8178-1afe87ccd2e9 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:54.224771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0d7c520c-451d-4dd0-8178-1afe87ccd2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:54.292207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:54.302866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 578/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:54.326847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9d160-fac7-483e-856a-3f9e3c92dfad None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:54.441068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9d160-fac7-483e-856a-3f9e3c92dfad None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:54.483824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87986872-8a12-4248-9e3f-8820566f7926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:54.484622 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87986872-8a12-4248-9e3f-8820566f7926 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:54.484944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87986872-8a12-4248-9e3f-8820566f7926 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:54.485309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87986872-8a12-4248-9e3f-8820566f7926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:54.496727 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87986872-8a12-4248-9e3f-8820566f7926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-87986872-8a12-4248-9e3f-8820566f7926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:54.504302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:54.505457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:54.506392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 563/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:54.512331 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c520c-451d-4dd0-8178-1afe87ccd2e9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:54.623336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c520c-451d-4dd0-8178-1afe87ccd2e9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:54.659055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08365e3-9411-405a-aa21-1945f115f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:54.659717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08365e3-9411-405a-aa21-1945f115f119 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:54.660005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08365e3-9411-405a-aa21-1945f115f119 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:54.660283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08365e3-9411-405a-aa21-1945f115f119 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:54.661560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08365e3-9411-405a-aa21-1945f115f119 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:54.661883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08365e3-9411-405a-aa21-1945f115f119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:54.663263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08365e3-9411-405a-aa21-1945f115f119 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:54.671509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 579/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:54.680465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87986872-8a12-4248-9e3f-8820566f7926 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:54.727601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:54.782295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87986872-8a12-4248-9e3f-8820566f7926 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:54.820050 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fd4b4-6e1c-4702-bdb2-882693c1afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:54.820933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fd4b4-6e1c-4702-bdb2-882693c1afc9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:54.821212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fd4b4-6e1c-4702-bdb2-882693c1afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:54.821484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fd4b4-6e1c-4702-bdb2-882693c1afc9 None admin] PATH_INFO: `/v3/users/25a5950b07ea4b829a9017629e9a294c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:54.837240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fd4b4-6e1c-4702-bdb2-882693c1afc9 None admin] RBAC: Authorizing `identity:get_user(user_id=25a5950b07ea4b829a9017629e9a294c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:54.839472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fd4b4-6e1c-4702-bdb2-882693c1afc9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:54.842093 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 564/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:54 2022] GET /identity/v3/users/25a5950b07ea4b829a9017629e9a294c => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:54.850275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08365e3-9411-405a-aa21-1945f115f119 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:54.906274 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:54.958176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08365e3-9411-405a-aa21-1945f115f119 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:54.999583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec894d-c66f-4c10-b4a4-c6419062a9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:55.000224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec894d-c66f-4c10-b4a4-c6419062a9dc None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:55.000508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec894d-c66f-4c10-b4a4-c6419062a9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:55.000812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec894d-c66f-4c10-b4a4-c6419062a9dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:55.069243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec894d-c66f-4c10-b4a4-c6419062a9dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:55.070582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec894d-c66f-4c10-b4a4-c6419062a9dc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:55.125677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:55.183559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 580/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:06:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:06:55.192508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fd4b4-6e1c-4702-bdb2-882693c1afc9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:55.300946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fd4b4-6e1c-4702-bdb2-882693c1afc9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:55.302572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:55.345142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52f8de-4cd0-4581-a157-d83d2f7adbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:55.345927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52f8de-4cd0-4581-a157-d83d2f7adbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:55.346205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52f8de-4cd0-4581-a157-d83d2f7adbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:55.346500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52f8de-4cd0-4581-a157-d83d2f7adbe2 None admin] PATH_INFO: `/v3/projects/bc34f4c2416b4ab381d9fe1775538693` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:55.347725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52f8de-4cd0-4581-a157-d83d2f7adbe2 None admin] RBAC: Authorizing `identity:get_project(project_id=bc34f4c2416b4ab381d9fe1775538693)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:55.349241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52f8de-4cd0-4581-a157-d83d2f7adbe2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:55.350957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 565/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:06:55 2022] GET /identity/v3/projects/bc34f4c2416b4ab381d9fe1775538693 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:55.358086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec894d-c66f-4c10-b4a4-c6419062a9dc None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:55.485280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec894d-c66f-4c10-b4a4-c6419062a9dc None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:55.521131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e204f2-8882-4529-bb38-18c310b2b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:55.521798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e204f2-8882-4529-bb38-18c310b2b01e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:55.522084 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e204f2-8882-4529-bb38-18c310b2b01e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:55.522354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e204f2-8882-4529-bb38-18c310b2b01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:55.523196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e204f2-8882-4529-bb38-18c310b2b01e None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=bc34f4c2416b4ab381d9fe1775538693, user.id=25a5950b07ea4b829a9017629e9a294c) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:55.523507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e204f2-8882-4529-bb38-18c310b2b01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:55.524972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e204f2-8882-4529-bb38-18c310b2b01e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:55.531712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 581/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:06:55 2022] GET /identity/v3/role_assignments?user.id=25a5950b07ea4b829a9017629e9a294c&scope.project.id=bc34f4c2416b4ab381d9fe1775538693&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:57.507229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77190c73-77f9-4fef-a564-b8b53c78aa05 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:57.508476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77190c73-77f9-4fef-a564-b8b53c78aa05 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:57.509022 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77190c73-77f9-4fef-a564-b8b53c78aa05 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:57.511285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 566/1147] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:06:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:06:57.516776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4fe88-36aa-444c-9a6c-36edef222617 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:57.517189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4fe88-36aa-444c-9a6c-36edef222617 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:57.517277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4fe88-36aa-444c-9a6c-36edef222617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:57.535094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-64b4fe88-36aa-444c-9a6c-36edef222617 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:06:57.536275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-64b4fe88-36aa-444c-9a6c-36edef222617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:06:57.551991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:57.609939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 582/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:06:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:06:57.634160 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77190c73-77f9-4fef-a564-b8b53c78aa05 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:57.751302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77190c73-77f9-4fef-a564-b8b53c78aa05 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:57.789868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c44405-c4d9-4d7c-82ad-8d586b7f9bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:57.791199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c44405-c4d9-4d7c-82ad-8d586b7f9bbb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:57.791661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c44405-c4d9-4d7c-82ad-8d586b7f9bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:57.792110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c44405-c4d9-4d7c-82ad-8d586b7f9bbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:57.809520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c44405-c4d9-4d7c-82ad-8d586b7f9bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e4c44405-c4d9-4d7c-82ad-8d586b7f9bbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:06:57.818783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:06:57.819846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:06:57.820939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 567/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:06:57.826756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4fe88-36aa-444c-9a6c-36edef222617 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:57.940350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4fe88-36aa-444c-9a6c-36edef222617 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:57.976090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd572af3-9d7c-4dae-a229-b70f79c35829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:57.976798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd572af3-9d7c-4dae-a229-b70f79c35829 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:57.977080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd572af3-9d7c-4dae-a229-b70f79c35829 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:57.977357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd572af3-9d7c-4dae-a229-b70f79c35829 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:57.978104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd572af3-9d7c-4dae-a229-b70f79c35829 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:06:57.978414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd572af3-9d7c-4dae-a229-b70f79c35829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:57.979783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd572af3-9d7c-4dae-a229-b70f79c35829 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:57.987993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 583/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:06:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:57.994758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c44405-c4d9-4d7c-82ad-8d586b7f9bbb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:58.039659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:58.114452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c44405-c4d9-4d7c-82ad-8d586b7f9bbb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:58.153960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8fb61-6196-43e1-88f0-a1fa1e53a11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:58.154831 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8fb61-6196-43e1-88f0-a1fa1e53a11b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:58.155114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8fb61-6196-43e1-88f0-a1fa1e53a11b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:58.155377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8fb61-6196-43e1-88f0-a1fa1e53a11b None admin] PATH_INFO: `/v3/users/25a5950b07ea4b829a9017629e9a294c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:58.156709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8fb61-6196-43e1-88f0-a1fa1e53a11b None admin] RBAC: Authorizing `identity:get_user(user_id=25a5950b07ea4b829a9017629e9a294c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:58.158128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8fb61-6196-43e1-88f0-a1fa1e53a11b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:58.159770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 568/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:06:57 2022] GET /identity/v3/users/25a5950b07ea4b829a9017629e9a294c => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:58.166642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd572af3-9d7c-4dae-a229-b70f79c35829 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:58.188311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:58.281685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd572af3-9d7c-4dae-a229-b70f79c35829 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:58.317367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49696e65-a81b-463b-b668-54946b7dcaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:58.318221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696e65-a81b-463b-b668-54946b7dcaca None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:58.318499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696e65-a81b-463b-b668-54946b7dcaca None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:58.318766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696e65-a81b-463b-b668-54946b7dcaca None admin] PATH_INFO: `/v3/projects/bc34f4c2416b4ab381d9fe1775538693` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:58.320060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49696e65-a81b-463b-b668-54946b7dcaca None admin] RBAC: Authorizing `identity:get_project(project_id=bc34f4c2416b4ab381d9fe1775538693)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:58.321649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49696e65-a81b-463b-b668-54946b7dcaca None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:58.323316 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 584/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:06:58 2022] GET /identity/v3/projects/bc34f4c2416b4ab381d9fe1775538693 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:06:58.329602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8fb61-6196-43e1-88f0-a1fa1e53a11b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:06:58.435398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:06:58.439622 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8fb61-6196-43e1-88f0-a1fa1e53a11b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:06:58.478517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfadf2-b9cc-4bff-ac36-c5c9f527a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:06:58.479398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfadf2-b9cc-4bff-ac36-c5c9f527a7de None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:06:58.479679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfadf2-b9cc-4bff-ac36-c5c9f527a7de None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:06:58.479949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfadf2-b9cc-4bff-ac36-c5c9f527a7de None admin] PATH_INFO: `/v3/projects/bc34f4c2416b4ab381d9fe1775538693/users/25a5950b07ea4b829a9017629e9a294c/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:06:58.482166 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfadf2-b9cc-4bff-ac36-c5c9f527a7de None admin] RBAC: Authorizing `identity:create_grant(project_id=bc34f4c2416b4ab381d9fe1775538693, user_id=25a5950b07ea4b829a9017629e9a294c, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:06:58.483593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfadf2-b9cc-4bff-ac36-c5c9f527a7de None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:06:58.502330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 569/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:06:58 2022] PUT /identity/v3/projects/bc34f4c2416b4ab381d9fe1775538693/users/25a5950b07ea4b829a9017629e9a294c/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:07:00.468288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48b67-2341-427c-8532-1cfc7157460f None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:00.469230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48b67-2341-427c-8532-1cfc7157460f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:00.469230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48b67-2341-427c-8532-1cfc7157460f None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:00.471439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 585/1154] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:07:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:07:00.477862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69099-a000-4659-a66a-a2b37d425ab6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:00.478298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69099-a000-4659-a66a-a2b37d425ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:00.478431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69099-a000-4659-a66a-a2b37d425ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:00.502474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b6f69099-a000-4659-a66a-a2b37d425ab6 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:07:00.503650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b6f69099-a000-4659-a66a-a2b37d425ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:07:00.578346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 570/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:07:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:07:00.602788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b48b67-2341-427c-8532-1cfc7157460f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:00.693220 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:00.715137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b48b67-2341-427c-8532-1cfc7157460f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:00.749696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2be757-d2dd-40d9-8a58-a73bea16182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:00.750473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be757-d2dd-40d9-8a58-a73bea16182b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:00.750752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be757-d2dd-40d9-8a58-a73bea16182b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:00.751025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be757-d2dd-40d9-8a58-a73bea16182b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:00.762803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2be757-d2dd-40d9-8a58-a73bea16182b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5c2be757-d2dd-40d9-8a58-a73bea16182b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:07:00.770349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:07:00.771413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:07:00.772719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 586/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:07:00.781559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f69099-a000-4659-a66a-a2b37d425ab6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:00.877614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:00.891224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f69099-a000-4659-a66a-a2b37d425ab6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:00.928401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0ead9-a6dc-4eb8-bb2d-6a2189e9e202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:00.929095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0ead9-a6dc-4eb8-bb2d-6a2189e9e202 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:00.929377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0ead9-a6dc-4eb8-bb2d-6a2189e9e202 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:00.929650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0ead9-a6dc-4eb8-bb2d-6a2189e9e202 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:00.930407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0ead9-a6dc-4eb8-bb2d-6a2189e9e202 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:07:00.930716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0ead9-a6dc-4eb8-bb2d-6a2189e9e202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:00.932079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0ead9-a6dc-4eb8-bb2d-6a2189e9e202 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:00.940619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 571/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:00.947452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2be757-d2dd-40d9-8a58-a73bea16182b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:01.061080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2be757-d2dd-40d9-8a58-a73bea16182b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:01.103241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab19755-64b1-477f-9367-cb98936cbd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:01.104113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab19755-64b1-477f-9367-cb98936cbd73 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:01.104397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab19755-64b1-477f-9367-cb98936cbd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:01.104706 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab19755-64b1-477f-9367-cb98936cbd73 None admin] PATH_INFO: `/v3/users/25a5950b07ea4b829a9017629e9a294c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:01.106589 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab19755-64b1-477f-9367-cb98936cbd73 None admin] RBAC: Authorizing `identity:get_user(user_id=25a5950b07ea4b829a9017629e9a294c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:01.108032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab19755-64b1-477f-9367-cb98936cbd73 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:01.109677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 587/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:07:00 2022] GET /identity/v3/users/25a5950b07ea4b829a9017629e9a294c => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:01.115677 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0ead9-a6dc-4eb8-bb2d-6a2189e9e202 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:01.219686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0ead9-a6dc-4eb8-bb2d-6a2189e9e202 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:01.254703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bf11f-2566-4678-9429-86f36c512625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:01.255333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bf11f-2566-4678-9429-86f36c512625 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:01.255618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bf11f-2566-4678-9429-86f36c512625 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:01.255892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bf11f-2566-4678-9429-86f36c512625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:01.275310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:01.334460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bf11f-2566-4678-9429-86f36c512625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:01.335907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bf11f-2566-4678-9429-86f36c512625 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:01.454134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 572/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:07:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:07:01.463107 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab19755-64b1-477f-9367-cb98936cbd73 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:01.475718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:01.570317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab19755-64b1-477f-9367-cb98936cbd73 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:01.611311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573c83c-bda0-469f-a2aa-5e897eb6c554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:01.612179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c83c-bda0-469f-a2aa-5e897eb6c554 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:01.612461 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c83c-bda0-469f-a2aa-5e897eb6c554 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:01.612765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c83c-bda0-469f-a2aa-5e897eb6c554 None admin] PATH_INFO: `/v3/projects/bc34f4c2416b4ab381d9fe1775538693` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:01.614014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573c83c-bda0-469f-a2aa-5e897eb6c554 None admin] RBAC: Authorizing `identity:get_project(project_id=bc34f4c2416b4ab381d9fe1775538693)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:01.615490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573c83c-bda0-469f-a2aa-5e897eb6c554 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:01.617240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 588/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:07:01 2022] GET /identity/v3/projects/bc34f4c2416b4ab381d9fe1775538693 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:01.623867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bf11f-2566-4678-9429-86f36c512625 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:01.674416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:01.726890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bf11f-2566-4678-9429-86f36c512625 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:01.763427 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e527ac2-f22e-4f55-b133-7058bd786164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:01.764071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527ac2-f22e-4f55-b133-7058bd786164 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:01.764356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527ac2-f22e-4f55-b133-7058bd786164 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:01.764633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e527ac2-f22e-4f55-b133-7058bd786164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:01.765499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e527ac2-f22e-4f55-b133-7058bd786164 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=bc34f4c2416b4ab381d9fe1775538693, user.id=25a5950b07ea4b829a9017629e9a294c) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:07:01.765807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e527ac2-f22e-4f55-b133-7058bd786164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:01.767233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e527ac2-f22e-4f55-b133-7058bd786164 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:01.773214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 573/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:07:01 2022] GET /identity/v3/role_assignments?user.id=25a5950b07ea4b829a9017629e9a294c&scope.project.id=bc34f4c2416b4ab381d9fe1775538693&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:03.787584 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91789de-b495-44c3-9194-ca149530394b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:03.788472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91789de-b495-44c3-9194-ca149530394b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:03.788472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91789de-b495-44c3-9194-ca149530394b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:03.790641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 589/1162] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:07:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:07:03.796973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac59df-4496-4752-871e-bb70cb39e49c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:03.797681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac59df-4496-4752-871e-bb70cb39e49c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:03.797831 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac59df-4496-4752-871e-bb70cb39e49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:03.826093 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-54ac59df-4496-4752-871e-bb70cb39e49c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:07:03.827471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-54ac59df-4496-4752-871e-bb70cb39e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:07:03.903543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 574/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:07:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:07:03.926330 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91789de-b495-44c3-9194-ca149530394b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:04.010774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:04.048012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91789de-b495-44c3-9194-ca149530394b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:04.085257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79845a-68ba-47df-88bf-920481a2de71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:04.085918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79845a-68ba-47df-88bf-920481a2de71 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:04.086199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79845a-68ba-47df-88bf-920481a2de71 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:04.086472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79845a-68ba-47df-88bf-920481a2de71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:04.157458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79845a-68ba-47df-88bf-920481a2de71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:04.158894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79845a-68ba-47df-88bf-920481a2de71 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:04.238990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:04.263191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 590/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:07:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:07:04.269538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac59df-4496-4752-871e-bb70cb39e49c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:04.321529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:04.382377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac59df-4496-4752-871e-bb70cb39e49c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:04.418559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f330d-7a70-484f-85fc-7cf8f295d726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:04.419365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f330d-7a70-484f-85fc-7cf8f295d726 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:04.419643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f330d-7a70-484f-85fc-7cf8f295d726 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:04.419917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f330d-7a70-484f-85fc-7cf8f295d726 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:04.427792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f330d-7a70-484f-85fc-7cf8f295d726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:04.429266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f330d-7a70-484f-85fc-7cf8f295d726 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-c11f330d-7a70-484f-85fc-7cf8f295d726 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:07:04.444245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:07:04.445512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:07:04.446875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 575/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jul 14 09:07:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:07:04.451854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79845a-68ba-47df-88bf-920481a2de71 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:04.563068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79845a-68ba-47df-88bf-920481a2de71 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:04.599491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffe085-ea1b-41f5-8c1e-46501198c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:04.600071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffe085-ea1b-41f5-8c1e-46501198c8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:04.600336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffe085-ea1b-41f5-8c1e-46501198c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:04.600610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffe085-ea1b-41f5-8c1e-46501198c8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:04.601365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffe085-ea1b-41f5-8c1e-46501198c8b8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:07:04.601668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffe085-ea1b-41f5-8c1e-46501198c8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:04.603022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffe085-ea1b-41f5-8c1e-46501198c8b8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:04.610306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 591/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jul 14 09:07:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:06.596879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8e5f3-c50a-4ebe-a659-efcfad0ac3ef None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:06.597742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8e5f3-c50a-4ebe-a659-efcfad0ac3ef None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:06.597871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8e5f3-c50a-4ebe-a659-efcfad0ac3ef None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:06.600005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 576/1167] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:07:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:07:06.606398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f800b2-aeb6-4d06-bfa1-bc010ff994a1 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:06.607150 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f800b2-aeb6-4d06-bfa1-bc010ff994a1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:06.607297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f800b2-aeb6-4d06-bfa1-bc010ff994a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:06.627460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-44f800b2-aeb6-4d06-bfa1-bc010ff994a1 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:07:06.628563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-44f800b2-aeb6-4d06-bfa1-bc010ff994a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:07:06.669269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:06.703075 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 592/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:07:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:07:06.739232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8e5f3-c50a-4ebe-a659-efcfad0ac3ef None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:06.860852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8e5f3-c50a-4ebe-a659-efcfad0ac3ef None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:06.863241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:06.897100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc9936-ecd9-4b73-a7ac-0ec4871acde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:06.897681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc9936-ecd9-4b73-a7ac-0ec4871acde7 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:06.897964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc9936-ecd9-4b73-a7ac-0ec4871acde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:06.898235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc9936-ecd9-4b73-a7ac-0ec4871acde7 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:06.898969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc9936-ecd9-4b73-a7ac-0ec4871acde7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:06.900335 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc9936-ecd9-4b73-a7ac-0ec4871acde7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:06.923001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 577/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Thu Jul 14 09:07:06 2022] POST /identity/v3/domains => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:07:09.013684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2374f2f-e685-4a3a-a71e-9cb0c56baa2c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:09.014240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2374f2f-e685-4a3a-a71e-9cb0c56baa2c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:09.014240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2374f2f-e685-4a3a-a71e-9cb0c56baa2c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:09.015616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 593/1170] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:07:09.022318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84102d5-bb6c-4277-a62e-838fed157eb4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:09.023007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84102d5-bb6c-4277-a62e-838fed157eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:09.023167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84102d5-bb6c-4277-a62e-838fed157eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:09.051077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c84102d5-bb6c-4277-a62e-838fed157eb4 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:07:09.052249 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c84102d5-bb6c-4277-a62e-838fed157eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:07:09.122028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 578/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:07:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:07:09.154831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2374f2f-e685-4a3a-a71e-9cb0c56baa2c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:09.283190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2374f2f-e685-4a3a-a71e-9cb0c56baa2c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:09.326387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f63f1f-bef8-4d25-87ec-79d700e13cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:09.327710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63f1f-bef8-4d25-87ec-79d700e13cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:09.328145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63f1f-bef8-4d25-87ec-79d700e13cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:09.328570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63f1f-bef8-4d25-87ec-79d700e13cf7 None admin] PATH_INFO: `/v3/domains/65356d567d0042c7a4405b6bb455ae0b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:09.352091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f63f1f-bef8-4d25-87ec-79d700e13cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=65356d567d0042c7a4405b6bb455ae0b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:09.353573 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f63f1f-bef8-4d25-87ec-79d700e13cf7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:09.355230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 594/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Thu Jul 14 09:07:09 2022] GET /identity/v3/domains/65356d567d0042c7a4405b6bb455ae0b => generated 267 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:09.361805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84102d5-bb6c-4277-a62e-838fed157eb4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:09.460984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:09.469137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84102d5-bb6c-4277-a62e-838fed157eb4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:09.510844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b15a8-d792-4fe6-bede-b89a3b2cacaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:09.511504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b15a8-d792-4fe6-bede-b89a3b2cacaa None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:09.511782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b15a8-d792-4fe6-bede-b89a3b2cacaa None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:09.512055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b15a8-d792-4fe6-bede-b89a3b2cacaa None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:09.512800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b15a8-d792-4fe6-bede-b89a3b2cacaa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:09.514232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b15a8-d792-4fe6-bede-b89a3b2cacaa None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:09.544902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 579/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:07:09 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:07:11.632311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400ad8-8e74-471a-a542-88181a775090 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:11.633161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400ad8-8e74-471a-a542-88181a775090 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:11.633161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400ad8-8e74-471a-a542-88181a775090 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:11.635310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 595/1174] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:07:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:07:11.644333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390467a-f1d3-4da1-8dc7-172b498c0d36 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:11.645403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390467a-f1d3-4da1-8dc7-172b498c0d36 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:11.645403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390467a-f1d3-4da1-8dc7-172b498c0d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:11.669108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7390467a-f1d3-4da1-8dc7-172b498c0d36 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:07:11.670286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7390467a-f1d3-4da1-8dc7-172b498c0d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:07:11.747462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 580/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:07:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:07:11.773586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400ad8-8e74-471a-a542-88181a775090 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:11.807350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:11.885418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400ad8-8e74-471a-a542-88181a775090 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:11.920814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbd998-e692-442e-abcc-cf71bed607df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:11.921674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbd998-e692-442e-abcc-cf71bed607df None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:11.921948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbd998-e692-442e-abcc-cf71bed607df None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:11.922223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbd998-e692-442e-abcc-cf71bed607df None admin] PATH_INFO: `/v3/domains/65356d567d0042c7a4405b6bb455ae0b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:11.923432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbd998-e692-442e-abcc-cf71bed607df None admin] RBAC: Authorizing `identity:get_domain(domain_id=65356d567d0042c7a4405b6bb455ae0b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:11.924893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbd998-e692-442e-abcc-cf71bed607df None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:11.926757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 596/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Thu Jul 14 09:07:11 2022] GET /identity/v3/domains/65356d567d0042c7a4405b6bb455ae0b => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:11.932883 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390467a-f1d3-4da1-8dc7-172b498c0d36 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:12.020553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:12.049012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390467a-f1d3-4da1-8dc7-172b498c0d36 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:12.084458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c47bb-149d-4ae9-bd53-0cba7bad5018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:12.085149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c47bb-149d-4ae9-bd53-0cba7bad5018 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:12.085435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c47bb-149d-4ae9-bd53-0cba7bad5018 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:12.085699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c47bb-149d-4ae9-bd53-0cba7bad5018 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:12.086405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c47bb-149d-4ae9-bd53-0cba7bad5018 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:12.087831 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c47bb-149d-4ae9-bd53-0cba7bad5018 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:12.114389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 581/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:07:11 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:07:14.157437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326fb7c-3b53-4a13-b124-3fd6ce4f04ed None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:14.158053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326fb7c-3b53-4a13-b124-3fd6ce4f04ed None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:14.158053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326fb7c-3b53-4a13-b124-3fd6ce4f04ed None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:14.159349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 597/1178] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:07:14.165915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6dcf2-572a-4a18-8be9-748c380fd051 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:14.166664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6dcf2-572a-4a18-8be9-748c380fd051 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:14.166818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6dcf2-572a-4a18-8be9-748c380fd051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:14.189943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8cf6dcf2-572a-4a18-8be9-748c380fd051 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:07:14.191133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8cf6dcf2-572a-4a18-8be9-748c380fd051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:07:14.265194 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 582/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:07:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:07:14.288377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326fb7c-3b53-4a13-b124-3fd6ce4f04ed None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:14.393532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:14.399149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326fb7c-3b53-4a13-b124-3fd6ce4f04ed None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:14.434442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2313db9-b187-4db6-962f-0cbdab8b6bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:14.435168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2313db9-b187-4db6-962f-0cbdab8b6bce None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:14.435446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2313db9-b187-4db6-962f-0cbdab8b6bce None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:14.435715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2313db9-b187-4db6-962f-0cbdab8b6bce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:14.447197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2313db9-b187-4db6-962f-0cbdab8b6bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-e2313db9-b187-4db6-962f-0cbdab8b6bce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:07:14.454672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:07:14.455833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:07:14.456951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 598/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:07:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:07:14.463891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6dcf2-572a-4a18-8be9-748c380fd051 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:14.525216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:14.565159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6dcf2-572a-4a18-8be9-748c380fd051 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:14.600681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0a8f8-06b7-41da-8446-1ea55ec2c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:14.601677 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a8f8-06b7-41da-8446-1ea55ec2c232 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:14.601967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a8f8-06b7-41da-8446-1ea55ec2c232 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:14.602239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a8f8-06b7-41da-8446-1ea55ec2c232 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:14.602996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0a8f8-06b7-41da-8446-1ea55ec2c232 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:07:14.603300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0a8f8-06b7-41da-8446-1ea55ec2c232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:14.604692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0a8f8-06b7-41da-8446-1ea55ec2c232 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:14.613029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 583/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:07:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:14.619368 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2313db9-b187-4db6-962f-0cbdab8b6bce None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:14.726258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2313db9-b187-4db6-962f-0cbdab8b6bce None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:14.762161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27497b8-a7ed-4e12-8cd2-de2f1e4781a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:14.763026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27497b8-a7ed-4e12-8cd2-de2f1e4781a2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:14.763300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27497b8-a7ed-4e12-8cd2-de2f1e4781a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:14.763571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27497b8-a7ed-4e12-8cd2-de2f1e4781a2 None admin] PATH_INFO: `/v3/users/8811f2254e5840058db5da7ee7eecad9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:14.777550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27497b8-a7ed-4e12-8cd2-de2f1e4781a2 None admin] RBAC: Authorizing `identity:get_user(user_id=8811f2254e5840058db5da7ee7eecad9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:14.778986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27497b8-a7ed-4e12-8cd2-de2f1e4781a2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:14.780620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 599/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:07:14 2022] GET /identity/v3/users/8811f2254e5840058db5da7ee7eecad9 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:14.786839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0a8f8-06b7-41da-8446-1ea55ec2c232 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:14.904164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0a8f8-06b7-41da-8446-1ea55ec2c232 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:14.927823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:14.942154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35faae1-708e-4339-92ab-cc9304e0578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:14.942808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35faae1-708e-4339-92ab-cc9304e0578b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:14.943092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35faae1-708e-4339-92ab-cc9304e0578b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:14.943370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35faae1-708e-4339-92ab-cc9304e0578b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:15.015783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35faae1-708e-4339-92ab-cc9304e0578b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:15.017378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35faae1-708e-4339-92ab-cc9304e0578b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:15.124753 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 584/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:07:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:07:15.131608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27497b8-a7ed-4e12-8cd2-de2f1e4781a2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:15.156587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:15.248364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27497b8-a7ed-4e12-8cd2-de2f1e4781a2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:15.284081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3864b6-65d7-4e64-9504-a1190166a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:15.284901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3864b6-65d7-4e64-9504-a1190166a49f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:15.285181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3864b6-65d7-4e64-9504-a1190166a49f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:15.285454 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3864b6-65d7-4e64-9504-a1190166a49f None admin] PATH_INFO: `/v3/projects/6f9a05ecf68e422d8850461bca4d947b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:15.286739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3864b6-65d7-4e64-9504-a1190166a49f None admin] RBAC: Authorizing `identity:get_project(project_id=6f9a05ecf68e422d8850461bca4d947b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:15.288239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3864b6-65d7-4e64-9504-a1190166a49f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:15.289937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 600/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:07:15 2022] GET /identity/v3/projects/6f9a05ecf68e422d8850461bca4d947b => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:15.296455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35faae1-708e-4339-92ab-cc9304e0578b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:15.323300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:15.410387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35faae1-708e-4339-92ab-cc9304e0578b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:15.447755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f53d7-48c4-4e6a-9657-25fda2731381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:15.448408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f53d7-48c4-4e6a-9657-25fda2731381 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:15.448693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f53d7-48c4-4e6a-9657-25fda2731381 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:15.448995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f53d7-48c4-4e6a-9657-25fda2731381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:15.449835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f53d7-48c4-4e6a-9657-25fda2731381 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=6f9a05ecf68e422d8850461bca4d947b, user.id=8811f2254e5840058db5da7ee7eecad9) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:07:15.450147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f53d7-48c4-4e6a-9657-25fda2731381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:15.451556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f53d7-48c4-4e6a-9657-25fda2731381 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:15.457232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 585/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:07:15 2022] GET /identity/v3/role_assignments?user.id=8811f2254e5840058db5da7ee7eecad9&scope.project.id=6f9a05ecf68e422d8850461bca4d947b&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:17.433324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306c56b-ddb0-4f5f-a4b8-c52ad848f959 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:17.434162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306c56b-ddb0-4f5f-a4b8-c52ad848f959 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:17.434162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306c56b-ddb0-4f5f-a4b8-c52ad848f959 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:17.436394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 601/1186] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:07:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:07:17.442994 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cabc7-eda1-4df9-969e-a1d5f6879125 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:17.443717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cabc7-eda1-4df9-969e-a1d5f6879125 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:17.443892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cabc7-eda1-4df9-969e-a1d5f6879125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:17.463117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1e7cabc7-eda1-4df9-969e-a1d5f6879125 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:07:17.464287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1e7cabc7-eda1-4df9-969e-a1d5f6879125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:07:17.538722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 586/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:07:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:07:17.574503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306c56b-ddb0-4f5f-a4b8-c52ad848f959 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:17.675798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:17.693991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306c56b-ddb0-4f5f-a4b8-c52ad848f959 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:17.729379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f857d22-279d-4dbe-96df-05f5781351f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:17.730161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f857d22-279d-4dbe-96df-05f5781351f3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:17.730446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f857d22-279d-4dbe-96df-05f5781351f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:17.730722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f857d22-279d-4dbe-96df-05f5781351f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:17.741415 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f857d22-279d-4dbe-96df-05f5781351f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2f857d22-279d-4dbe-96df-05f5781351f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:07:17.749012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:07:17.750171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:07:17.751213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 602/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:07:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:07:17.757291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cabc7-eda1-4df9-969e-a1d5f6879125 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:17.777690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:17.871740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cabc7-eda1-4df9-969e-a1d5f6879125 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:17.908643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68d041-0149-4c81-b4f2-9f9c3fb9e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:17.909329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68d041-0149-4c81-b4f2-9f9c3fb9e076 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:17.909613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68d041-0149-4c81-b4f2-9f9c3fb9e076 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:17.909888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68d041-0149-4c81-b4f2-9f9c3fb9e076 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:17.910645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68d041-0149-4c81-b4f2-9f9c3fb9e076 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:07:17.910949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68d041-0149-4c81-b4f2-9f9c3fb9e076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:17.912318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68d041-0149-4c81-b4f2-9f9c3fb9e076 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:17.921303 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 587/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:07:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:17.930339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f857d22-279d-4dbe-96df-05f5781351f3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:18.046531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f857d22-279d-4dbe-96df-05f5781351f3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:18.083742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bed7b-8a10-432b-8929-eb915596540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:18.084614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bed7b-8a10-432b-8929-eb915596540c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:18.084934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bed7b-8a10-432b-8929-eb915596540c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:18.085209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bed7b-8a10-432b-8929-eb915596540c None admin] PATH_INFO: `/v3/users/8811f2254e5840058db5da7ee7eecad9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:18.086493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bed7b-8a10-432b-8929-eb915596540c None admin] RBAC: Authorizing `identity:get_user(user_id=8811f2254e5840058db5da7ee7eecad9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:18.087928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bed7b-8a10-432b-8929-eb915596540c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:18.089597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 603/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:07:17 2022] GET /identity/v3/users/8811f2254e5840058db5da7ee7eecad9 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:18.095659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68d041-0149-4c81-b4f2-9f9c3fb9e076 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:18.187514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:18.211776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68d041-0149-4c81-b4f2-9f9c3fb9e076 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:18.251298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31069beb-3b92-4ccc-a943-57f66b123717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:18.252162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069beb-3b92-4ccc-a943-57f66b123717 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:18.252442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069beb-3b92-4ccc-a943-57f66b123717 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:18.252704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069beb-3b92-4ccc-a943-57f66b123717 None admin] PATH_INFO: `/v3/projects/6f9a05ecf68e422d8850461bca4d947b` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:18.253958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31069beb-3b92-4ccc-a943-57f66b123717 None admin] RBAC: Authorizing `identity:get_project(project_id=6f9a05ecf68e422d8850461bca4d947b)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:18.255394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31069beb-3b92-4ccc-a943-57f66b123717 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:18.257144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 588/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:07:18 2022] GET /identity/v3/projects/6f9a05ecf68e422d8850461bca4d947b => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:18.264012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bed7b-8a10-432b-8929-eb915596540c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:18.288854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:18.394047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bed7b-8a10-432b-8929-eb915596540c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:18.428893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366a28-3cb1-41f7-a1f3-c901f90e01ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:18.429784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366a28-3cb1-41f7-a1f3-c901f90e01ec None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:18.430069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366a28-3cb1-41f7-a1f3-c901f90e01ec None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:18.430382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366a28-3cb1-41f7-a1f3-c901f90e01ec None admin] PATH_INFO: `/v3/projects/6f9a05ecf68e422d8850461bca4d947b/users/8811f2254e5840058db5da7ee7eecad9/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:18.432627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb366a28-3cb1-41f7-a1f3-c901f90e01ec None admin] RBAC: Authorizing `identity:create_grant(project_id=6f9a05ecf68e422d8850461bca4d947b, user_id=8811f2254e5840058db5da7ee7eecad9, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:18.434101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb366a28-3cb1-41f7-a1f3-c901f90e01ec None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:18.449992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 604/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:07:18 2022] PUT /identity/v3/projects/6f9a05ecf68e422d8850461bca4d947b/users/8811f2254e5840058db5da7ee7eecad9/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:07:20.418845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f71968-8c13-4dd0-9252-4315202ad264 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:20.419326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f71968-8c13-4dd0-9252-4315202ad264 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:20.419326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f71968-8c13-4dd0-9252-4315202ad264 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:20.420806 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 589/1193] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:07:20.426964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b504bb7-295a-4b0d-b143-91a24da266d5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:20.427715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b504bb7-295a-4b0d-b143-91a24da266d5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:20.427860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b504bb7-295a-4b0d-b143-91a24da266d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:20.453387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4b504bb7-295a-4b0d-b143-91a24da266d5 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:07:20.454577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4b504bb7-295a-4b0d-b143-91a24da266d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:07:20.530118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 605/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:07:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:07:20.557662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f71968-8c13-4dd0-9252-4315202ad264 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:20.666465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f71968-8c13-4dd0-9252-4315202ad264 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:20.700906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c0be-4dfb-44c8-a4e7-076256d57ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:20.701713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c0be-4dfb-44c8-a4e7-076256d57ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:20.702024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c0be-4dfb-44c8-a4e7-076256d57ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:20.702284 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c0be-4dfb-44c8-a4e7-076256d57ff5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:20.713368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34c0be-4dfb-44c8-a4e7-076256d57ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-ae34c0be-4dfb-44c8-a4e7-076256d57ff5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:07:20.720938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:07:20.722011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:07:20.723011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 590/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:07:20.730679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b504bb7-295a-4b0d-b143-91a24da266d5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:20.732916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:20.845406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b504bb7-295a-4b0d-b143-91a24da266d5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:20.882471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931866-a882-4053-bdd1-491959d6456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:20.883126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931866-a882-4053-bdd1-491959d6456b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:20.883398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931866-a882-4053-bdd1-491959d6456b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:20.883669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931866-a882-4053-bdd1-491959d6456b None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:20.884409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b931866-a882-4053-bdd1-491959d6456b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:07:20.884734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b931866-a882-4053-bdd1-491959d6456b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:20.886111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b931866-a882-4053-bdd1-491959d6456b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:20.894351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 606/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:20.902703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c0be-4dfb-44c8-a4e7-076256d57ff5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:20.914997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:21.010939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c0be-4dfb-44c8-a4e7-076256d57ff5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:21.045979 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da6b15-1641-474f-9855-0280bec7230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:21.046858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da6b15-1641-474f-9855-0280bec7230e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:21.047143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da6b15-1641-474f-9855-0280bec7230e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:21.047420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da6b15-1641-474f-9855-0280bec7230e None admin] PATH_INFO: `/v3/users/8811f2254e5840058db5da7ee7eecad9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:21.048706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da6b15-1641-474f-9855-0280bec7230e None admin] RBAC: Authorizing `identity:get_user(user_id=8811f2254e5840058db5da7ee7eecad9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:21.050199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da6b15-1641-474f-9855-0280bec7230e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:21.051846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 591/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jul 14 09:07:20 2022] GET /identity/v3/users/8811f2254e5840058db5da7ee7eecad9 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:07:21.058127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931866-a882-4053-bdd1-491959d6456b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:21.125814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:21.175586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931866-a882-4053-bdd1-491959d6456b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:21.210451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37402864-2704-4713-b51b-36c06ddff95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:21.211102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37402864-2704-4713-b51b-36c06ddff95e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:21.211407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37402864-2704-4713-b51b-36c06ddff95e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:21.211684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37402864-2704-4713-b51b-36c06ddff95e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:21.282279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37402864-2704-4713-b51b-36c06ddff95e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:21.283656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37402864-2704-4713-b51b-36c06ddff95e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:21.345647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:21.387409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 607/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:07:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:07:21.393471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da6b15-1641-474f-9855-0280bec7230e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:21.476078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:21.501733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da6b15-1641-474f-9855-0280bec7230e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:21.539975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b565e09-b60a-4e6a-843c-6250cae777c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:21.540791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565e09-b60a-4e6a-843c-6250cae777c4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:21.541067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565e09-b60a-4e6a-843c-6250cae777c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:21.541335 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565e09-b60a-4e6a-843c-6250cae777c4 None admin] PATH_INFO: `/v3/projects/6f9a05ecf68e422d8850461bca4d947b` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:21.542892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b565e09-b60a-4e6a-843c-6250cae777c4 None admin] RBAC: Authorizing `identity:get_project(project_id=6f9a05ecf68e422d8850461bca4d947b)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:21.544319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b565e09-b60a-4e6a-843c-6250cae777c4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:21.546038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 592/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jul 14 09:07:21 2022] GET /identity/v3/projects/6f9a05ecf68e422d8850461bca4d947b => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:07:21.552489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37402864-2704-4713-b51b-36c06ddff95e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:07:21.658827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37402864-2704-4713-b51b-36c06ddff95e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:07:21.693870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa3429-1fc4-4a27-882f-47dcfad4f051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:07:21.694515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa3429-1fc4-4a27-882f-47dcfad4f051 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:07:21.694796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa3429-1fc4-4a27-882f-47dcfad4f051 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:07:21.695169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa3429-1fc4-4a27-882f-47dcfad4f051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:07:21.695999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa3429-1fc4-4a27-882f-47dcfad4f051 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=6f9a05ecf68e422d8850461bca4d947b, user.id=8811f2254e5840058db5da7ee7eecad9) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:07:21.696308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa3429-1fc4-4a27-882f-47dcfad4f051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:07:21.697807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa3429-1fc4-4a27-882f-47dcfad4f051 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:07:21.704434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 608/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:07:21 2022] GET /identity/v3/role_assignments?user.id=8811f2254e5840058db5da7ee7eecad9&scope.project.id=6f9a05ecf68e422d8850461bca4d947b&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:07:31.534537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=28 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:07:31.701285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=86 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:16.593895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fc003-d4d4-4aec-a169-6f3c252b60bd None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:16.594525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fc003-d4d4-4aec-a169-6f3c252b60bd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:16.594525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fc003-d4d4-4aec-a169-6f3c252b60bd None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:16.596373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 593/1201] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:08:16.601885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82813ef1-5968-482f-84e8-5057a9ecd748 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:16.602337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82813ef1-5968-482f-84e8-5057a9ecd748 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:16.602445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82813ef1-5968-482f-84e8-5057a9ecd748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:16.623575 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-82813ef1-5968-482f-84e8-5057a9ecd748 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:16.624849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-82813ef1-5968-482f-84e8-5057a9ecd748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:16.708686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 609/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:08:16.734470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fc003-d4d4-4aec-a169-6f3c252b60bd None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:16.853670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fc003-d4d4-4aec-a169-6f3c252b60bd None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:16.896413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922fec5-d216-41c3-a443-f0bbcc4df402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:16.897253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922fec5-d216-41c3-a443-f0bbcc4df402 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:16.897535 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922fec5-d216-41c3-a443-f0bbcc4df402 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:16.897805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922fec5-d216-41c3-a443-f0bbcc4df402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:16.909934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922fec5-d216-41c3-a443-f0bbcc4df402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:16.911520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922fec5-d216-41c3-a443-f0bbcc4df402 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-1922fec5-d216-41c3-a443-f0bbcc4df402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:16.931274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:16.932407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:16.933437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:16.933437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:16.933437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:16.933437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:16.933437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 594/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:16.939502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82813ef1-5968-482f-84e8-5057a9ecd748 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:17.060409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82813ef1-5968-482f-84e8-5057a9ecd748 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:17.093736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:17.101146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba7044-b06f-46af-940c-fe03cec07454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:17.102082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba7044-b06f-46af-940c-fe03cec07454 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:17.102430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba7044-b06f-46af-940c-fe03cec07454 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:17.102707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba7044-b06f-46af-940c-fe03cec07454 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:17.103450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba7044-b06f-46af-940c-fe03cec07454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:17.103777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba7044-b06f-46af-940c-fe03cec07454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:17.105198 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba7044-b06f-46af-940c-fe03cec07454 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:17.119300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 610/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:17.125529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922fec5-d216-41c3-a443-f0bbcc4df402 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:17.199721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:17.255949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922fec5-d216-41c3-a443-f0bbcc4df402 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:17.297623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0620b-8947-48e2-a264-e38c7e0280c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:17.298336 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0620b-8947-48e2-a264-e38c7e0280c3 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:17.298598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0620b-8947-48e2-a264-e38c7e0280c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:17.298874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0620b-8947-48e2-a264-e38c7e0280c3 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:17.299607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0620b-8947-48e2-a264-e38c7e0280c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:17.301079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0620b-8947-48e2-a264-e38c7e0280c3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:17.325545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 595/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jul 14 09:08:17 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:08:19.497266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b1d2-67f1-4d6c-9725-f82b06a25225 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:19.498051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b1d2-67f1-4d6c-9725-f82b06a25225 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:19.498051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b1d2-67f1-4d6c-9725-f82b06a25225 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:19.499657 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 611/1206] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:08:19.505016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d7c5-7505-44b1-987e-0e489b88c448 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:19.505502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d7c5-7505-44b1-987e-0e489b88c448 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:19.505591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d7c5-7505-44b1-987e-0e489b88c448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:19.524367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-afb7d7c5-7505-44b1-987e-0e489b88c448 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:19.525652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-afb7d7c5-7505-44b1-987e-0e489b88c448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:19.602168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 596/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:08:19.625717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b1d2-67f1-4d6c-9725-f82b06a25225 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:19.738036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b1d2-67f1-4d6c-9725-f82b06a25225 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:19.779235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff37cb8-8445-459a-81db-d42c75b33bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:19.780054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff37cb8-8445-459a-81db-d42c75b33bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:19.780378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff37cb8-8445-459a-81db-d42c75b33bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:19.780625 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff37cb8-8445-459a-81db-d42c75b33bc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:19.796311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff37cb8-8445-459a-81db-d42c75b33bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-cff37cb8-8445-459a-81db-d42c75b33bc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:08:19.804275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:19.805593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:19.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 612/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:08:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:19.816503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d7c5-7505-44b1-987e-0e489b88c448 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:19.859085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:19.928606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d7c5-7505-44b1-987e-0e489b88c448 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:19.965951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b5cd3-c064-4ceb-9712-aef374d9f7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:19.966628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b5cd3-c064-4ceb-9712-aef374d9f7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:19.966937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b5cd3-c064-4ceb-9712-aef374d9f7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:19.967187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b5cd3-c064-4ceb-9712-aef374d9f7a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:19.967950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b5cd3-c064-4ceb-9712-aef374d9f7a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:19.968259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b5cd3-c064-4ceb-9712-aef374d9f7a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:19.969666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b5cd3-c064-4ceb-9712-aef374d9f7a7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:19.979384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 597/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:08:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:19.985445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff37cb8-8445-459a-81db-d42c75b33bc8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:20.039613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:20.092852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff37cb8-8445-459a-81db-d42c75b33bc8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:20.132547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5110773-a9dc-4982-bdc7-2c91c1addc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:20.133426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5110773-a9dc-4982-bdc7-2c91c1addc5a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:20.133679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5110773-a9dc-4982-bdc7-2c91c1addc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:20.133989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5110773-a9dc-4982-bdc7-2c91c1addc5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:20.147558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5110773-a9dc-4982-bdc7-2c91c1addc5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:20.149184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5110773-a9dc-4982-bdc7-2c91c1addc5a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-f5110773-a9dc-4982-bdc7-2c91c1addc5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:20.170946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:20.172186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:20.173153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:20.173153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:20.173153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:20.173153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:20.173153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 613/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:20.178147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b5cd3-c064-4ceb-9712-aef374d9f7a7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:20.287346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:20.290914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b5cd3-c064-4ceb-9712-aef374d9f7a7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:20.330245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733f58c-4303-4e98-97f9-9ac9e8802030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:20.330951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733f58c-4303-4e98-97f9-9ac9e8802030 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:20.331268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733f58c-4303-4e98-97f9-9ac9e8802030 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:20.331575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733f58c-4303-4e98-97f9-9ac9e8802030 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:20.332370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733f58c-4303-4e98-97f9-9ac9e8802030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:20.332756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733f58c-4303-4e98-97f9-9ac9e8802030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:20.334101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733f58c-4303-4e98-97f9-9ac9e8802030 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:20.347132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 598/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:20.353393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5110773-a9dc-4982-bdc7-2c91c1addc5a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:20.468723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5110773-a9dc-4982-bdc7-2c91c1addc5a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:20.470379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:20.508485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4864f1b-5c8a-4b5a-a4a2-09ea35dc7232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:20.509372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4864f1b-5c8a-4b5a-a4a2-09ea35dc7232 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:20.509682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4864f1b-5c8a-4b5a-a4a2-09ea35dc7232 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:20.509961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4864f1b-5c8a-4b5a-a4a2-09ea35dc7232 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:20.517972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4864f1b-5c8a-4b5a-a4a2-09ea35dc7232 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:20.519426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4864f1b-5c8a-4b5a-a4a2-09ea35dc7232 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c4864f1b-5c8a-4b5a-a4a2-09ea35dc7232 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:08:20.534957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:20.535998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:20.537049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 614/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:20.542243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733f58c-4303-4e98-97f9-9ac9e8802030 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:20.653357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733f58c-4303-4e98-97f9-9ac9e8802030 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:20.696036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37d8dc-2bb8-4d93-a54b-f04cbe593384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:20.696756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d8dc-2bb8-4d93-a54b-f04cbe593384 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:20.697088 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d8dc-2bb8-4d93-a54b-f04cbe593384 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:20.697320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d8dc-2bb8-4d93-a54b-f04cbe593384 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:20.698169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37d8dc-2bb8-4d93-a54b-f04cbe593384 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:20.698470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37d8dc-2bb8-4d93-a54b-f04cbe593384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:20.699917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37d8dc-2bb8-4d93-a54b-f04cbe593384 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:20.718026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 599/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jul 14 09:08:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:08:20.724142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4864f1b-5c8a-4b5a-a4a2-09ea35dc7232 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:20.833635 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4864f1b-5c8a-4b5a-a4a2-09ea35dc7232 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:20.871506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233c3d3-4ea7-4b9c-867c-f022412fa5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:20.872204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233c3d3-4ea7-4b9c-867c-f022412fa5fb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:20.872494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233c3d3-4ea7-4b9c-867c-f022412fa5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:20.872798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233c3d3-4ea7-4b9c-867c-f022412fa5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:20.907963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:20.951347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233c3d3-4ea7-4b9c-867c-f022412fa5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:20.952905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233c3d3-4ea7-4b9c-867c-f022412fa5fb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:21.078342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 615/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:08:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:08:21.084618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37d8dc-2bb8-4d93-a54b-f04cbe593384 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:21.107807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:21.205754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37d8dc-2bb8-4d93-a54b-f04cbe593384 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:21.245411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3ffc-2d9f-4be1-ac10-555f85f22b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:21.246224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3ffc-2d9f-4be1-ac10-555f85f22b50 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:21.246507 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3ffc-2d9f-4be1-ac10-555f85f22b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:21.246798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3ffc-2d9f-4be1-ac10-555f85f22b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:21.258277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd3ffc-2d9f-4be1-ac10-555f85f22b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:21.259765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd3ffc-2d9f-4be1-ac10-555f85f22b50 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d5cd3ffc-2d9f-4be1-ac10-555f85f22b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:21.280754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:21.281893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:21.283010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:21.283010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:21.283010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:21.283010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:21.283010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 600/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:21.290702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233c3d3-4ea7-4b9c-867c-f022412fa5fb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:21.355026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:21.399071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233c3d3-4ea7-4b9c-867c-f022412fa5fb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:21.437110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989158b-9f0c-4359-b01e-fecf43ca8e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:21.437791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989158b-9f0c-4359-b01e-fecf43ca8e59 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:21.438090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989158b-9f0c-4359-b01e-fecf43ca8e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:21.438356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989158b-9f0c-4359-b01e-fecf43ca8e59 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:21.439119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989158b-9f0c-4359-b01e-fecf43ca8e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:21.439502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989158b-9f0c-4359-b01e-fecf43ca8e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:21.440943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989158b-9f0c-4359-b01e-fecf43ca8e59 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:21.453608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 616/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:21.459967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3ffc-2d9f-4be1-ac10-555f85f22b50 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:21.544239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:21.586115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3ffc-2d9f-4be1-ac10-555f85f22b50 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:21.626435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016d540-37db-465c-8af5-5b10c1a774d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:21.627348 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d540-37db-465c-8af5-5b10c1a774d3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:21.627706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d540-37db-465c-8af5-5b10c1a774d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:21.628063 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d540-37db-465c-8af5-5b10c1a774d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:21.636340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016d540-37db-465c-8af5-5b10c1a774d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:21.638021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016d540-37db-465c-8af5-5b10c1a774d3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-1016d540-37db-465c-8af5-5b10c1a774d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:08:21.653733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:21.655031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:21.656152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:08:21.656152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:08:21.656152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:08:21.656152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:08:21.656152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:08:21.656152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:08:21.656152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:21.656152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:21.662157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 601/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:21.662319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989158b-9f0c-4359-b01e-fecf43ca8e59 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:21.781286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989158b-9f0c-4359-b01e-fecf43ca8e59 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:21.812793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:21.826083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff0ca3-ff84-426e-bf57-e306a11a1249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:21.827025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff0ca3-ff84-426e-bf57-e306a11a1249 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:21.827489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff0ca3-ff84-426e-bf57-e306a11a1249 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:21.827823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff0ca3-ff84-426e-bf57-e306a11a1249 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:21.828814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff0ca3-ff84-426e-bf57-e306a11a1249 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:21.829190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff0ca3-ff84-426e-bf57-e306a11a1249 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:21.831343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff0ca3-ff84-426e-bf57-e306a11a1249 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:21.854168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 617/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:21.854383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016d540-37db-465c-8af5-5b10c1a774d3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:21.976582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016d540-37db-465c-8af5-5b10c1a774d3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:22.009655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:22.017791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6f559-752c-4ee5-be56-125e3d8a66fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:22.018672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6f559-752c-4ee5-be56-125e3d8a66fa None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:22.018960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6f559-752c-4ee5-be56-125e3d8a66fa None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:22.019241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6f559-752c-4ee5-be56-125e3d8a66fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:22.020271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6f559-752c-4ee5-be56-125e3d8a66fa None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=58986e97f4d849aba35149d3666db015) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:22.020587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6f559-752c-4ee5-be56-125e3d8a66fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:22.022141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6f559-752c-4ee5-be56-125e3d8a66fa None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:22.029749 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 602/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:08:21 2022] GET /identity/v3/role_assignments?user.id=58986e97f4d849aba35149d3666db015&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:24.075357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39638177-9d26-4886-9e2f-4c14893da78d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:24.076159 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39638177-9d26-4886-9e2f-4c14893da78d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:24.076159 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39638177-9d26-4886-9e2f-4c14893da78d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:24.077507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 618/1220] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:08:24.082918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49ed33-d890-4cf0-9412-6f8d52c4bacb None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:24.083417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49ed33-d890-4cf0-9412-6f8d52c4bacb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:24.083532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49ed33-d890-4cf0-9412-6f8d52c4bacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:24.101587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-df49ed33-d890-4cf0-9412-6f8d52c4bacb None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:24.102820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-df49ed33-d890-4cf0-9412-6f8d52c4bacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:24.179338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 603/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:08:24.202596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39638177-9d26-4886-9e2f-4c14893da78d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:24.310062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39638177-9d26-4886-9e2f-4c14893da78d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:24.347565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b3db4-1814-4930-899d-14dd04c90622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:24.348296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3db4-1814-4930-899d-14dd04c90622 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:24.348577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3db4-1814-4930-899d-14dd04c90622 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:24.348877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3db4-1814-4930-899d-14dd04c90622 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:24.360849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b3db4-1814-4930-899d-14dd04c90622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-720b3db4-1814-4930-899d-14dd04c90622 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:08:24.368556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:24.369905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:24.370891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 619/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:08:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:08:24.376735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49ed33-d890-4cf0-9412-6f8d52c4bacb None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:24.487615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49ed33-d890-4cf0-9412-6f8d52c4bacb None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:24.513673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:24.525693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260f7b2-2db4-4609-929f-692f29a72ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:24.526685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260f7b2-2db4-4609-929f-692f29a72ecb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:24.527065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260f7b2-2db4-4609-929f-692f29a72ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:24.527441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260f7b2-2db4-4609-929f-692f29a72ecb None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:24.528454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260f7b2-2db4-4609-929f-692f29a72ecb None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:24.528857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260f7b2-2db4-4609-929f-692f29a72ecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:24.530622 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260f7b2-2db4-4609-929f-692f29a72ecb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:24.540141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 604/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:08:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:08:24.546294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b3db4-1814-4930-899d-14dd04c90622 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:24.593798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:24.660452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b3db4-1814-4930-899d-14dd04c90622 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:24.698458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5113f73-397f-41eb-8273-c04f7fb27af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:24.699302 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113f73-397f-41eb-8273-c04f7fb27af3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:24.699555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113f73-397f-41eb-8273-c04f7fb27af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:24.699833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113f73-397f-41eb-8273-c04f7fb27af3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:24.711570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5113f73-397f-41eb-8273-c04f7fb27af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:24.713071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5113f73-397f-41eb-8273-c04f7fb27af3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-f5113f73-397f-41eb-8273-c04f7fb27af3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:24.730062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:24.731081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:24.732185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:24.732185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:24.732185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:24.732185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:24.732185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 620/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:24.737872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260f7b2-2db4-4609-929f-692f29a72ecb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:24.846560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260f7b2-2db4-4609-929f-692f29a72ecb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:24.881975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe072-ee81-42b5-9512-bbf98b9975da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:24.882642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe072-ee81-42b5-9512-bbf98b9975da None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:24.882927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe072-ee81-42b5-9512-bbf98b9975da None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:24.883227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe072-ee81-42b5-9512-bbf98b9975da None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:24.883943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fe072-ee81-42b5-9512-bbf98b9975da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:24.884217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fe072-ee81-42b5-9512-bbf98b9975da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:24.885611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fe072-ee81-42b5-9512-bbf98b9975da None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:24.899681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 605/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:24.905857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5113f73-397f-41eb-8273-c04f7fb27af3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:25.007088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:25.015430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5113f73-397f-41eb-8273-c04f7fb27af3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:25.049622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2fb77-1dab-4f66-96a9-0831d296a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:25.050421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2fb77-1dab-4f66-96a9-0831d296a33e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:25.050722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2fb77-1dab-4f66-96a9-0831d296a33e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:25.050993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2fb77-1dab-4f66-96a9-0831d296a33e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:25.058511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2fb77-1dab-4f66-96a9-0831d296a33e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:25.059955 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2fb77-1dab-4f66-96a9-0831d296a33e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-65b2fb77-1dab-4f66-96a9-0831d296a33e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:08:25.076185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:25.077851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:25.078931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 621/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:08:25.083475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe072-ee81-42b5-9512-bbf98b9975da None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:25.134218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:25.191794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe072-ee81-42b5-9512-bbf98b9975da None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:25.228508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea176a-b9a5-4f5e-9f9c-6583e1d1c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:25.229220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea176a-b9a5-4f5e-9f9c-6583e1d1c940 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:25.229503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea176a-b9a5-4f5e-9f9c-6583e1d1c940 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:25.229776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea176a-b9a5-4f5e-9f9c-6583e1d1c940 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:25.230619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea176a-b9a5-4f5e-9f9c-6583e1d1c940 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:25.230926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea176a-b9a5-4f5e-9f9c-6583e1d1c940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:25.232443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea176a-b9a5-4f5e-9f9c-6583e1d1c940 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:25.250682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 606/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jul 14 09:08:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:25.256540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2fb77-1dab-4f66-96a9-0831d296a33e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:25.358699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2fb77-1dab-4f66-96a9-0831d296a33e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:25.394741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818d88c-470e-445c-87f4-ecbb3c3723a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:25.395545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818d88c-470e-445c-87f4-ecbb3c3723a0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:25.395821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818d88c-470e-445c-87f4-ecbb3c3723a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:25.396092 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818d88c-470e-445c-87f4-ecbb3c3723a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:25.406806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818d88c-470e-445c-87f4-ecbb3c3723a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:25.408266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818d88c-470e-445c-87f4-ecbb3c3723a0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5818d88c-470e-445c-87f4-ecbb3c3723a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:25.425548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:25.426581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:25.427639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:25.427639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:25.427639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:25.427639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:25.427639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 622/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:25.432649 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea176a-b9a5-4f5e-9f9c-6583e1d1c940 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:25.539958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea176a-b9a5-4f5e-9f9c-6583e1d1c940 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:25.542405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:25.580558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d448669-1a6e-43b8-a4b9-9956dda3f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:25.581310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d448669-1a6e-43b8-a4b9-9956dda3f88c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:25.581536 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d448669-1a6e-43b8-a4b9-9956dda3f88c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:25.581809 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d448669-1a6e-43b8-a4b9-9956dda3f88c None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:25.582691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d448669-1a6e-43b8-a4b9-9956dda3f88c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:25.582831 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d448669-1a6e-43b8-a4b9-9956dda3f88c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:25.584211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d448669-1a6e-43b8-a4b9-9956dda3f88c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:25.596620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 607/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:25.602674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818d88c-470e-445c-87f4-ecbb3c3723a0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:25.612710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:25.721009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818d88c-470e-445c-87f4-ecbb3c3723a0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:25.756970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8969da-16fc-4c77-b050-efb19f9809d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:25.757777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8969da-16fc-4c77-b050-efb19f9809d2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:25.758053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8969da-16fc-4c77-b050-efb19f9809d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:25.758325 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8969da-16fc-4c77-b050-efb19f9809d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:25.765848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8969da-16fc-4c77-b050-efb19f9809d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:25.767291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8969da-16fc-4c77-b050-efb19f9809d2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-4c8969da-16fc-4c77-b050-efb19f9809d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:08:25.782766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:25.783910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:25.785678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:08:25.785678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:08:25.785678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:08:25.785678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:08:25.785678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:08:25.785678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:08:25.785678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:25.785678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:25.785678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 623/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:25.790199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d448669-1a6e-43b8-a4b9-9956dda3f88c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:25.899462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d448669-1a6e-43b8-a4b9-9956dda3f88c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:25.935982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fae1c2-4ba8-43f9-849d-24b32e5089c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:25.936847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae1c2-4ba8-43f9-849d-24b32e5089c1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:25.937127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae1c2-4ba8-43f9-849d-24b32e5089c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:25.937398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae1c2-4ba8-43f9-849d-24b32e5089c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:25.938254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fae1c2-4ba8-43f9-849d-24b32e5089c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:25.938618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fae1c2-4ba8-43f9-849d-24b32e5089c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:25.940712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fae1c2-4ba8-43f9-849d-24b32e5089c1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:25.955001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 608/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:25.960951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8969da-16fc-4c77-b050-efb19f9809d2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:26.038022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:26.076046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8969da-16fc-4c77-b050-efb19f9809d2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:26.113912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc034a1-1033-4dd1-8244-00ef9eab2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:26.114847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc034a1-1033-4dd1-8244-00ef9eab2c06 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:26.115126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc034a1-1033-4dd1-8244-00ef9eab2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:26.115404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc034a1-1033-4dd1-8244-00ef9eab2c06 None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/58986e97f4d849aba35149d3666db015/roles/14d87e5720e84adba77d427eed713973` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:26.132941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc034a1-1033-4dd1-8244-00ef9eab2c06 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=58986e97f4d849aba35149d3666db015, role_id=14d87e5720e84adba77d427eed713973)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:26.134436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc034a1-1033-4dd1-8244-00ef9eab2c06 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:26.148103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 624/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:08:25 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/58986e97f4d849aba35149d3666db015/roles/14d87e5720e84adba77d427eed713973 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:08:28.190385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ff74-863a-4a97-b67e-4b50b5ee831a None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:28.191226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ff74-863a-4a97-b67e-4b50b5ee831a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:28.191376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ff74-863a-4a97-b67e-4b50b5ee831a None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:28.193776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 609/1233] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:08:28.201434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede080d-88c3-4c97-8c4f-d1748bb97ba7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:28.201434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede080d-88c3-4c97-8c4f-d1748bb97ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:28.202554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede080d-88c3-4c97-8c4f-d1748bb97ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:28.223476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-fede080d-88c3-4c97-8c4f-d1748bb97ba7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:28.224883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fede080d-88c3-4c97-8c4f-d1748bb97ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:28.298636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 625/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:08:28.322893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0ff74-863a-4a97-b67e-4b50b5ee831a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:28.351752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:28.438751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0ff74-863a-4a97-b67e-4b50b5ee831a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:28.473069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2fd5-9563-464b-886e-1028fbf1aaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:28.473873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2fd5-9563-464b-886e-1028fbf1aaee None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:28.474147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2fd5-9563-464b-886e-1028fbf1aaee None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:28.474418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2fd5-9563-464b-886e-1028fbf1aaee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:28.484953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c2fd5-9563-464b-886e-1028fbf1aaee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-9d6c2fd5-9563-464b-886e-1028fbf1aaee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:08:28.492611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:28.493796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:28.494690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 610/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jul 14 09:08:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:28.500248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede080d-88c3-4c97-8c4f-d1748bb97ba7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:28.551901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:28.612928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede080d-88c3-4c97-8c4f-d1748bb97ba7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:28.650082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0224f-24d8-4cab-aa52-c334c121b46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:28.650836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0224f-24d8-4cab-aa52-c334c121b46a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:28.651116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0224f-24d8-4cab-aa52-c334c121b46a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:28.651392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0224f-24d8-4cab-aa52-c334c121b46a None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:28.652169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0224f-24d8-4cab-aa52-c334c121b46a None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:28.652478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0224f-24d8-4cab-aa52-c334c121b46a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:28.653888 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0224f-24d8-4cab-aa52-c334c121b46a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:28.663884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 626/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jul 14 09:08:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:28.669914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2fd5-9563-464b-886e-1028fbf1aaee None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:28.759700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:28.778868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2fd5-9563-464b-886e-1028fbf1aaee None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:28.815076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb466b0-e742-4c5d-9c71-a3e9707fb3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:28.816007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb466b0-e742-4c5d-9c71-a3e9707fb3ef None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:28.816364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb466b0-e742-4c5d-9c71-a3e9707fb3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:28.816764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb466b0-e742-4c5d-9c71-a3e9707fb3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:28.827945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb466b0-e742-4c5d-9c71-a3e9707fb3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:28.829453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb466b0-e742-4c5d-9c71-a3e9707fb3ef None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-6fb466b0-e742-4c5d-9c71-a3e9707fb3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:28.846643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:28.847587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:28.848498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:28.848498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:28.848498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:28.848498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:28.848498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 611/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:28.853909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0224f-24d8-4cab-aa52-c334c121b46a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:28.957299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0224f-24d8-4cab-aa52-c334c121b46a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:28.967041 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:28.993400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e46248-7909-4182-b0ce-211395fb7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:28.994226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46248-7909-4182-b0ce-211395fb7b55 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:28.994525 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46248-7909-4182-b0ce-211395fb7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:28.994850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46248-7909-4182-b0ce-211395fb7b55 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:28.995593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e46248-7909-4182-b0ce-211395fb7b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:28.995898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e46248-7909-4182-b0ce-211395fb7b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:28.997302 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e46248-7909-4182-b0ce-211395fb7b55 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:29.009642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 627/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:29.015748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb466b0-e742-4c5d-9c71-a3e9707fb3ef None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:29.121386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb466b0-e742-4c5d-9c71-a3e9707fb3ef None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:29.157358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7629c1-cc74-4ea9-bbe4-a7480373a9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:29.158167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7629c1-cc74-4ea9-bbe4-a7480373a9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:29.158453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7629c1-cc74-4ea9-bbe4-a7480373a9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:29.158731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7629c1-cc74-4ea9-bbe4-a7480373a9d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:29.161612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:29.167289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7629c1-cc74-4ea9-bbe4-a7480373a9d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:29.170458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7629c1-cc74-4ea9-bbe4-a7480373a9d7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-6b7629c1-cc74-4ea9-bbe4-a7480373a9d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:08:29.186773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:29.188031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:29.189207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 612/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:29.194571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e46248-7909-4182-b0ce-211395fb7b55 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:29.318687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e46248-7909-4182-b0ce-211395fb7b55 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:29.355316 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39835148-de62-45c4-bcb7-e0f3e5330013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:29.356047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39835148-de62-45c4-bcb7-e0f3e5330013 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:29.356332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39835148-de62-45c4-bcb7-e0f3e5330013 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:29.356604 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39835148-de62-45c4-bcb7-e0f3e5330013 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:29.357471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39835148-de62-45c4-bcb7-e0f3e5330013 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:29.358124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39835148-de62-45c4-bcb7-e0f3e5330013 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:29.359628 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39835148-de62-45c4-bcb7-e0f3e5330013 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:29.381529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 628/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jul 14 09:08:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:29.387624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7629c1-cc74-4ea9-bbe4-a7480373a9d7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:29.497013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7629c1-cc74-4ea9-bbe4-a7480373a9d7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:29.533948 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cd6f5-9b9c-42ad-9c36-86ab569722e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:29.535191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cd6f5-9b9c-42ad-9c36-86ab569722e8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:29.535626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cd6f5-9b9c-42ad-9c36-86ab569722e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:29.535932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cd6f5-9b9c-42ad-9c36-86ab569722e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:29.607912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:29.622879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cd6f5-9b9c-42ad-9c36-86ab569722e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:29.624580 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cd6f5-9b9c-42ad-9c36-86ab569722e8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:29.758815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 613/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:08:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:08:29.765387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39835148-de62-45c4-bcb7-e0f3e5330013 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:29.803239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:29.896144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39835148-de62-45c4-bcb7-e0f3e5330013 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:29.944620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b23515-9fad-4d2a-a542-92d70af89625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:29.945471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23515-9fad-4d2a-a542-92d70af89625 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:29.945754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23515-9fad-4d2a-a542-92d70af89625 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:29.946031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23515-9fad-4d2a-a542-92d70af89625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:29.963263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b23515-9fad-4d2a-a542-92d70af89625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:29.964809 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b23515-9fad-4d2a-a542-92d70af89625 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-23b23515-9fad-4d2a-a542-92d70af89625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:29.986131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:29.987366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:29.988284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:29.988284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:29.988284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:29.988284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:29.988284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 629/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:29.993664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cd6f5-9b9c-42ad-9c36-86ab569722e8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:30.105296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:30.112824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cd6f5-9b9c-42ad-9c36-86ab569722e8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:30.162154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ace90-8d11-44b4-896e-e174caaf1aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:30.162793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ace90-8d11-44b4-896e-e174caaf1aaf None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:30.163078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ace90-8d11-44b4-896e-e174caaf1aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:30.163486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ace90-8d11-44b4-896e-e174caaf1aaf None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:30.164358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ace90-8d11-44b4-896e-e174caaf1aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:30.164692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ace90-8d11-44b4-896e-e174caaf1aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:30.166334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ace90-8d11-44b4-896e-e174caaf1aaf None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:30.190051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 614/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:30.191561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b23515-9fad-4d2a-a542-92d70af89625 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:30.308176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:30.335953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b23515-9fad-4d2a-a542-92d70af89625 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:30.379496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ad67a-b546-41fb-b424-319e26e6fc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:30.380522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad67a-b546-41fb-b424-319e26e6fc4d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:30.381183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad67a-b546-41fb-b424-319e26e6fc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:30.381423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad67a-b546-41fb-b424-319e26e6fc4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:30.390882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ad67a-b546-41fb-b424-319e26e6fc4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:30.392381 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ad67a-b546-41fb-b424-319e26e6fc4d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b83ad67a-b546-41fb-b424-319e26e6fc4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:08:30.407629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:30.408793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:30.414458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:08:30.414458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:08:30.414458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:08:30.414458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:08:30.414458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:08:30.414458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:08:30.414458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:30.414458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:30.414458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 630/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:30.415175 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ace90-8d11-44b4-896e-e174caaf1aaf None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:30.522850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ace90-8d11-44b4-896e-e174caaf1aaf None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:30.557209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f97a8-4903-45d0-b0a4-e224803fc4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:30.557974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f97a8-4903-45d0-b0a4-e224803fc4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:30.558257 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f97a8-4903-45d0-b0a4-e224803fc4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:30.558548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f97a8-4903-45d0-b0a4-e224803fc4d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:30.559334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f97a8-4903-45d0-b0a4-e224803fc4d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:30.559650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f97a8-4903-45d0-b0a4-e224803fc4d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:30.561311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f97a8-4903-45d0-b0a4-e224803fc4d8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:30.574904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 615/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:08:30.581672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ad67a-b546-41fb-b424-319e26e6fc4d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:30.690676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ad67a-b546-41fb-b424-319e26e6fc4d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:30.729051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377ce10-4c23-45d4-aabe-b72283b33f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:30.729690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ce10-4c23-45d4-aabe-b72283b33f1a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:30.729972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ce10-4c23-45d4-aabe-b72283b33f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:30.730251 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ce10-4c23-45d4-aabe-b72283b33f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:30.731080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377ce10-4c23-45d4-aabe-b72283b33f1a None admin] RBAC: Adding query filter params (role.id=14d87e5720e84adba77d427eed713973, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=58986e97f4d849aba35149d3666db015) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:30.731440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377ce10-4c23-45d4-aabe-b72283b33f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:30.733048 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377ce10-4c23-45d4-aabe-b72283b33f1a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:30.739313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 631/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:08:30 2022] GET /identity/v3/role_assignments?user.id=58986e97f4d849aba35149d3666db015&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=14d87e5720e84adba77d427eed713973 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:08:32.915467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcf722-3997-4467-907c-c6a1eba205f1 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:32.916008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcf722-3997-4467-907c-c6a1eba205f1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:32.916008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcf722-3997-4467-907c-c6a1eba205f1 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:32.917440 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 616/1247] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:08:32.925790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e241a-091f-4244-a4f1-89ddc3daebf1 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:32.926286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e241a-091f-4244-a4f1-89ddc3daebf1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:32.926379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e241a-091f-4244-a4f1-89ddc3daebf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:32.931659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:32.944194 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-389e241a-091f-4244-a4f1-89ddc3daebf1 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:32.945527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-389e241a-091f-4244-a4f1-89ddc3daebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:33.016823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 632/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:08:33.039966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcf722-3997-4467-907c-c6a1eba205f1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:33.060653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:33.164873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcf722-3997-4467-907c-c6a1eba205f1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:33.212477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae07dae-15e4-4e0f-a6cb-b5f0a79d20be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:33.213401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07dae-15e4-4e0f-a6cb-b5f0a79d20be None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:33.213756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07dae-15e4-4e0f-a6cb-b5f0a79d20be None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:33.214065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07dae-15e4-4e0f-a6cb-b5f0a79d20be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:33.227706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae07dae-15e4-4e0f-a6cb-b5f0a79d20be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-1ae07dae-15e4-4e0f-a6cb-b5f0a79d20be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:08:33.236416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:33.237852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:33.239003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 617/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:08:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:33.244074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e241a-091f-4244-a4f1-89ddc3daebf1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:33.352186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e241a-091f-4244-a4f1-89ddc3daebf1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:33.386895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:33.393224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8a1f2-111f-4b91-a8af-509c1f1660a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:33.393988 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8a1f2-111f-4b91-a8af-509c1f1660a8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:33.394332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8a1f2-111f-4b91-a8af-509c1f1660a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:33.394679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8a1f2-111f-4b91-a8af-509c1f1660a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:33.395492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8a1f2-111f-4b91-a8af-509c1f1660a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:33.395794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8a1f2-111f-4b91-a8af-509c1f1660a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:33.397332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8a1f2-111f-4b91-a8af-509c1f1660a8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:33.406886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 633/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:08:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:33.412841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae07dae-15e4-4e0f-a6cb-b5f0a79d20be None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:33.494822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:33.519759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae07dae-15e4-4e0f-a6cb-b5f0a79d20be None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:33.557249 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec6e75-587e-44be-ba8c-021db2911350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:33.558126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec6e75-587e-44be-ba8c-021db2911350 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:33.558433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec6e75-587e-44be-ba8c-021db2911350 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:33.558725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec6e75-587e-44be-ba8c-021db2911350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:33.570593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec6e75-587e-44be-ba8c-021db2911350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:33.572126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec6e75-587e-44be-ba8c-021db2911350 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f3ec6e75-587e-44be-ba8c-021db2911350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:33.590068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:33.591072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:33.592243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:33.592243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:33.592243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:33.592243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:33.592243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 618/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:08:33.597464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8a1f2-111f-4b91-a8af-509c1f1660a8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:33.713626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8a1f2-111f-4b91-a8af-509c1f1660a8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:33.750561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca945a-3a58-4894-b69f-58c8da2c5242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:33.751416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca945a-3a58-4894-b69f-58c8da2c5242 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:33.751669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca945a-3a58-4894-b69f-58c8da2c5242 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:33.751940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca945a-3a58-4894-b69f-58c8da2c5242 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:33.752737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca945a-3a58-4894-b69f-58c8da2c5242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:33.753081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca945a-3a58-4894-b69f-58c8da2c5242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:33.754512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca945a-3a58-4894-b69f-58c8da2c5242 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:33.767872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 634/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:33.773807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec6e75-587e-44be-ba8c-021db2911350 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:33.892850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec6e75-587e-44be-ba8c-021db2911350 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:33.923307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:33.931613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a760c54-8161-43ab-96ef-daa141035a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:33.932530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a760c54-8161-43ab-96ef-daa141035a6a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:33.932866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a760c54-8161-43ab-96ef-daa141035a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:33.933136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a760c54-8161-43ab-96ef-daa141035a6a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:33.941472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a760c54-8161-43ab-96ef-daa141035a6a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:33.943005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a760c54-8161-43ab-96ef-daa141035a6a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-8a760c54-8161-43ab-96ef-daa141035a6a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:08:33.958714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:33.959832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:33.961266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 619/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:33.965760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca945a-3a58-4894-b69f-58c8da2c5242 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:34.027651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:34.077469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca945a-3a58-4894-b69f-58c8da2c5242 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:34.117460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10315b07-56fa-4c87-917d-58cbf877a12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:34.117814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10315b07-56fa-4c87-917d-58cbf877a12b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:34.118089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10315b07-56fa-4c87-917d-58cbf877a12b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:34.118367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10315b07-56fa-4c87-917d-58cbf877a12b None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:34.119215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10315b07-56fa-4c87-917d-58cbf877a12b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:34.119540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10315b07-56fa-4c87-917d-58cbf877a12b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:34.121026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10315b07-56fa-4c87-917d-58cbf877a12b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:34.142171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 635/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jul 14 09:08:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:08:34.148185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a760c54-8161-43ab-96ef-daa141035a6a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:34.266387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a760c54-8161-43ab-96ef-daa141035a6a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:34.303963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed31566-9920-43cb-b78b-33dd6ca3b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:34.304548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed31566-9920-43cb-b78b-33dd6ca3b36a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:34.304874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed31566-9920-43cb-b78b-33dd6ca3b36a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:34.305157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed31566-9920-43cb-b78b-33dd6ca3b36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:34.371155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:34.389036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed31566-9920-43cb-b78b-33dd6ca3b36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:34.391292 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed31566-9920-43cb-b78b-33dd6ca3b36a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:34.499658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 620/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:08:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:08:34.505923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10315b07-56fa-4c87-917d-58cbf877a12b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:34.624836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10315b07-56fa-4c87-917d-58cbf877a12b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:34.642206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:34.675867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774052b-e5bf-48a6-b212-9e429bd54dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:34.676688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774052b-e5bf-48a6-b212-9e429bd54dae None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:34.676988 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774052b-e5bf-48a6-b212-9e429bd54dae None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:34.677234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774052b-e5bf-48a6-b212-9e429bd54dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:34.689197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774052b-e5bf-48a6-b212-9e429bd54dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:34.690683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774052b-e5bf-48a6-b212-9e429bd54dae None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-9774052b-e5bf-48a6-b212-9e429bd54dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:34.709296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:34.710462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:34.711597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:34.711597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:34.711597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:34.711597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:34.715674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 636/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:08:34.716628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed31566-9920-43cb-b78b-33dd6ca3b36a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:34.816157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:34.831005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed31566-9920-43cb-b78b-33dd6ca3b36a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:34.872091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4cc14-2b32-4c3e-8166-23cba182fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:34.872837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4cc14-2b32-4c3e-8166-23cba182fbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:34.873118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4cc14-2b32-4c3e-8166-23cba182fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:34.873392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4cc14-2b32-4c3e-8166-23cba182fbb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:34.874199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4cc14-2b32-4c3e-8166-23cba182fbb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:34.874499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4cc14-2b32-4c3e-8166-23cba182fbb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:34.875960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4cc14-2b32-4c3e-8166-23cba182fbb7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:34.888597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 621/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:34.895006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774052b-e5bf-48a6-b212-9e429bd54dae None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:35.009125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774052b-e5bf-48a6-b212-9e429bd54dae None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:35.050822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db4f96-f781-42d9-ac06-d77e57d777f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:35.051711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db4f96-f781-42d9-ac06-d77e57d777f5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:35.052012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db4f96-f781-42d9-ac06-d77e57d777f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:35.052272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db4f96-f781-42d9-ac06-d77e57d777f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:35.062091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db4f96-f781-42d9-ac06-d77e57d777f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:35.063728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db4f96-f781-42d9-ac06-d77e57d777f5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b6db4f96-f781-42d9-ac06-d77e57d777f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:08:35.080615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:35.081637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:35.082576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:08:35.082576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:08:35.082576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:08:35.082576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:08:35.082576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:08:35.082576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:08:35.082576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:35.082576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:35.082576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 637/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:35.088049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4cc14-2b32-4c3e-8166-23cba182fbb7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:35.211248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4cc14-2b32-4c3e-8166-23cba182fbb7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:35.250161 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9ab51-f2bb-4c64-8552-0e94309299da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:35.251389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ab51-f2bb-4c64-8552-0e94309299da None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:35.251787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ab51-f2bb-4c64-8552-0e94309299da None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:35.252185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ab51-f2bb-4c64-8552-0e94309299da None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:35.253171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9ab51-f2bb-4c64-8552-0e94309299da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:35.253517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9ab51-f2bb-4c64-8552-0e94309299da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:35.255105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9ab51-f2bb-4c64-8552-0e94309299da None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:35.268214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 622/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:08:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:35.274582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db4f96-f781-42d9-ac06-d77e57d777f5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:35.306346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:35.390582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db4f96-f781-42d9-ac06-d77e57d777f5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:35.426364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf61e9a-fbf7-4ed0-bab7-5e69eb4a6144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:35.427028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61e9a-fbf7-4ed0-bab7-5e69eb4a6144 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:35.427313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61e9a-fbf7-4ed0-bab7-5e69eb4a6144 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:35.427593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61e9a-fbf7-4ed0-bab7-5e69eb4a6144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:35.428429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf61e9a-fbf7-4ed0-bab7-5e69eb4a6144 None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=58986e97f4d849aba35149d3666db015) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:35.428778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf61e9a-fbf7-4ed0-bab7-5e69eb4a6144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:35.430263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf61e9a-fbf7-4ed0-bab7-5e69eb4a6144 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:35.436005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 638/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:08:35 2022] GET /identity/v3/role_assignments?user.id=58986e97f4d849aba35149d3666db015&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:37.465785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59dab3-78b9-4969-bf85-a90d7fc4744e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:37.466697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59dab3-78b9-4969-bf85-a90d7fc4744e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:37.466697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59dab3-78b9-4969-bf85-a90d7fc4744e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:37.469045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 623/1261] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:08:37.474536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2adc36-fb55-49bf-9ec0-6ce89b1a0c98 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:37.474982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2adc36-fb55-49bf-9ec0-6ce89b1a0c98 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:37.475153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2adc36-fb55-49bf-9ec0-6ce89b1a0c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:37.493351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-bf2adc36-fb55-49bf-9ec0-6ce89b1a0c98 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:37.494515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bf2adc36-fb55-49bf-9ec0-6ce89b1a0c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:37.565697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 639/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:08:37.588723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59dab3-78b9-4969-bf85-a90d7fc4744e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:37.606150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:37.710645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59dab3-78b9-4969-bf85-a90d7fc4744e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:37.745298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c966db7-58bd-4265-bc28-1aab8b994bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:37.746078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966db7-58bd-4265-bc28-1aab8b994bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:37.746361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966db7-58bd-4265-bc28-1aab8b994bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:37.746630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966db7-58bd-4265-bc28-1aab8b994bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:37.757972 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c966db7-58bd-4265-bc28-1aab8b994bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-8c966db7-58bd-4265-bc28-1aab8b994bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:08:37.765630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:37.766716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:37.767974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 624/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:37.773786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2adc36-fb55-49bf-9ec0-6ce89b1a0c98 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:37.795313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:37.886648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2adc36-fb55-49bf-9ec0-6ce89b1a0c98 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:37.922678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf83991-97e0-4d66-a08b-01cfab208ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:37.923342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83991-97e0-4d66-a08b-01cfab208ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:37.923624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83991-97e0-4d66-a08b-01cfab208ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:37.923899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83991-97e0-4d66-a08b-01cfab208ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:37.924653 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf83991-97e0-4d66-a08b-01cfab208ac9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:37.924995 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf83991-97e0-4d66-a08b-01cfab208ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:37.926367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf83991-97e0-4d66-a08b-01cfab208ac9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:37.934626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 640/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:08:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:37.941325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c966db7-58bd-4265-bc28-1aab8b994bd6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:38.021472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:38.059207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c966db7-58bd-4265-bc28-1aab8b994bd6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:38.095812 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cb79e-fbc9-4cfe-9a58-c642d41ac1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:38.096591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cb79e-fbc9-4cfe-9a58-c642d41ac1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:38.096908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cb79e-fbc9-4cfe-9a58-c642d41ac1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:38.097180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cb79e-fbc9-4cfe-9a58-c642d41ac1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:38.109349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cb79e-fbc9-4cfe-9a58-c642d41ac1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:38.110792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cb79e-fbc9-4cfe-9a58-c642d41ac1d1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-090cb79e-fbc9-4cfe-9a58-c642d41ac1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:38.129200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:38.130276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:38.131434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:38.131434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:38.131434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:38.131434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:38.131434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 625/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:38.136856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf83991-97e0-4d66-a08b-01cfab208ac9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:38.232918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:38.254256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf83991-97e0-4d66-a08b-01cfab208ac9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:38.293027 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0daed0-f1ef-4d62-8849-440bb9ac8018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:38.293627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0daed0-f1ef-4d62-8849-440bb9ac8018 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:38.293909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0daed0-f1ef-4d62-8849-440bb9ac8018 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:38.294180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0daed0-f1ef-4d62-8849-440bb9ac8018 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:38.294899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0daed0-f1ef-4d62-8849-440bb9ac8018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:38.295202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0daed0-f1ef-4d62-8849-440bb9ac8018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:38.296617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0daed0-f1ef-4d62-8849-440bb9ac8018 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:38.309357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 641/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:38.318117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cb79e-fbc9-4cfe-9a58-c642d41ac1d1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:38.439719 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cb79e-fbc9-4cfe-9a58-c642d41ac1d1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:38.459950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:38.478180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a86f2-d33d-415e-a74b-423279224603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:38.478988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a86f2-d33d-415e-a74b-423279224603 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:38.479262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a86f2-d33d-415e-a74b-423279224603 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:38.479527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a86f2-d33d-415e-a74b-423279224603 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:38.488019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a86f2-d33d-415e-a74b-423279224603 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:38.489495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a86f2-d33d-415e-a74b-423279224603 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-245a86f2-d33d-415e-a74b-423279224603 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:08:38.504410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:38.505673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:38.506802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 626/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:08:38.511637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0daed0-f1ef-4d62-8849-440bb9ac8018 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:38.616165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0daed0-f1ef-4d62-8849-440bb9ac8018 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:38.651886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fba1e-6f48-4bb7-8ad0-3ad96c383253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:38.652547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fba1e-6f48-4bb7-8ad0-3ad96c383253 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:38.652866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fba1e-6f48-4bb7-8ad0-3ad96c383253 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:38.653143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fba1e-6f48-4bb7-8ad0-3ad96c383253 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:38.653973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fba1e-6f48-4bb7-8ad0-3ad96c383253 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:38.654278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fba1e-6f48-4bb7-8ad0-3ad96c383253 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:38.655778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fba1e-6f48-4bb7-8ad0-3ad96c383253 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:38.664429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:38.673863 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 642/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jul 14 09:08:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:38.679688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a86f2-d33d-415e-a74b-423279224603 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:38.780914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a86f2-d33d-415e-a74b-423279224603 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:38.815711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016e243-c26b-4bb1-8c8b-8b509cc66f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:38.816484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016e243-c26b-4bb1-8c8b-8b509cc66f77 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:38.816794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016e243-c26b-4bb1-8c8b-8b509cc66f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:38.817063 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016e243-c26b-4bb1-8c8b-8b509cc66f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:38.828107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016e243-c26b-4bb1-8c8b-8b509cc66f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:38.829594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016e243-c26b-4bb1-8c8b-8b509cc66f77 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-4016e243-c26b-4bb1-8c8b-8b509cc66f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:38.846811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:38.847824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:38.848810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:38.848810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:38.848810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:38.848810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:38.848810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 627/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:38.853822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fba1e-6f48-4bb7-8ad0-3ad96c383253 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:38.968021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fba1e-6f48-4bb7-8ad0-3ad96c383253 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:39.018921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce26b-3c57-4de5-a3a3-4b85ddf78b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:39.019590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce26b-3c57-4de5-a3a3-4b85ddf78b94 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:39.019894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce26b-3c57-4de5-a3a3-4b85ddf78b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:39.020146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce26b-3c57-4de5-a3a3-4b85ddf78b94 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:39.020916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ce26b-3c57-4de5-a3a3-4b85ddf78b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:39.021221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ce26b-3c57-4de5-a3a3-4b85ddf78b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:39.023529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ce26b-3c57-4de5-a3a3-4b85ddf78b94 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:39.040163 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 643/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:39.047460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016e243-c26b-4bb1-8c8b-8b509cc66f77 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:39.091733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:39.170184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016e243-c26b-4bb1-8c8b-8b509cc66f77 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:39.209653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8ab36-2835-4086-91f5-4bf61398f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:39.210591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8ab36-2835-4086-91f5-4bf61398f72a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:39.210925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8ab36-2835-4086-91f5-4bf61398f72a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:39.211228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8ab36-2835-4086-91f5-4bf61398f72a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:39.218963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8ab36-2835-4086-91f5-4bf61398f72a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:39.220404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8ab36-2835-4086-91f5-4bf61398f72a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-c2a8ab36-2835-4086-91f5-4bf61398f72a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:08:39.235046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:39.235988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:39.236997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:08:39.236997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:08:39.236997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:08:39.236997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:08:39.236997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:08:39.236997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:08:39.236997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:39.236997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:39.236997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 628/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:39.245365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce26b-3c57-4de5-a3a3-4b85ddf78b94 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:39.312140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:39.357816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce26b-3c57-4de5-a3a3-4b85ddf78b94 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:39.397514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2b980-9171-431d-880d-2d2d0b4eacf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:39.398174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2b980-9171-431d-880d-2d2d0b4eacf7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:39.398453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2b980-9171-431d-880d-2d2d0b4eacf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:39.398723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2b980-9171-431d-880d-2d2d0b4eacf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:39.399505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2b980-9171-431d-880d-2d2d0b4eacf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:39.399809 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2b980-9171-431d-880d-2d2d0b4eacf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:39.401304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2b980-9171-431d-880d-2d2d0b4eacf7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:39.414527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 644/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:08:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:39.421246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8ab36-2835-4086-91f5-4bf61398f72a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:39.532700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:39.546164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8ab36-2835-4086-91f5-4bf61398f72a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:39.592500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980d494-19e3-4d38-bd98-7ede425aadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:39.593501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980d494-19e3-4d38-bd98-7ede425aadc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:39.593784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980d494-19e3-4d38-bd98-7ede425aadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:39.594060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980d494-19e3-4d38-bd98-7ede425aadc2 None admin] PATH_INFO: `/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/58986e97f4d849aba35149d3666db015/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:39.596299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980d494-19e3-4d38-bd98-7ede425aadc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a3e3bae8f574e44a0782460fefc7162, user_id=58986e97f4d849aba35149d3666db015, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:39.597776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980d494-19e3-4d38-bd98-7ede425aadc2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:39.613583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 629/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jul 14 09:08:39 2022] PUT /identity/v3/projects/7a3e3bae8f574e44a0782460fefc7162/users/58986e97f4d849aba35149d3666db015/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:08:41.618242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01233e-d631-4cb9-9806-3c13fe17ebc9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:41.618814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01233e-d631-4cb9-9806-3c13fe17ebc9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:41.618814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01233e-d631-4cb9-9806-3c13fe17ebc9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:41.620177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 645/1274] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:08:41.626984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc27b7-0df3-477e-ac4c-5d546339af12 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:41.627700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc27b7-0df3-477e-ac4c-5d546339af12 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:41.627827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc27b7-0df3-477e-ac4c-5d546339af12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:41.655478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-99fc27b7-0df3-477e-ac4c-5d546339af12 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:41.656703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-99fc27b7-0df3-477e-ac4c-5d546339af12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:41.725289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 630/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:08:41.749979 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01233e-d631-4cb9-9806-3c13fe17ebc9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:41.861687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01233e-d631-4cb9-9806-3c13fe17ebc9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:41.879701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:41.902156 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fa7ac-2870-453b-b7ec-7330757be298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:41.902951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fa7ac-2870-453b-b7ec-7330757be298 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:41.903237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fa7ac-2870-453b-b7ec-7330757be298 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:41.903519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fa7ac-2870-453b-b7ec-7330757be298 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:41.914330 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fa7ac-2870-453b-b7ec-7330757be298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-970fa7ac-2870-453b-b7ec-7330757be298 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:08:41.921991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:41.923144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:41.925189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 646/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jul 14 09:08:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:41.932991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc27b7-0df3-477e-ac4c-5d546339af12 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:42.027591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:42.049442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc27b7-0df3-477e-ac4c-5d546339af12 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:42.085232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3876fd-799e-4cce-961e-05f7139e9909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:42.085905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3876fd-799e-4cce-961e-05f7139e9909 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:42.086211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3876fd-799e-4cce-961e-05f7139e9909 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:42.086451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3876fd-799e-4cce-961e-05f7139e9909 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:42.087215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3876fd-799e-4cce-961e-05f7139e9909 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:42.087517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3876fd-799e-4cce-961e-05f7139e9909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:42.088932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3876fd-799e-4cce-961e-05f7139e9909 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:42.098919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 631/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jul 14 09:08:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:42.107452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fa7ac-2870-453b-b7ec-7330757be298 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:42.218472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fa7ac-2870-453b-b7ec-7330757be298 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:42.259704 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedd395-2882-432e-b0ac-feea6ea9b9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:42.260491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd395-2882-432e-b0ac-feea6ea9b9de None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:42.260799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd395-2882-432e-b0ac-feea6ea9b9de None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:42.261076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd395-2882-432e-b0ac-feea6ea9b9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:42.272266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedd395-2882-432e-b0ac-feea6ea9b9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:42.273743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedd395-2882-432e-b0ac-feea6ea9b9de None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-0cedd395-2882-432e-b0ac-feea6ea9b9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:42.292171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:42.293284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:42.294897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:42.294897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:42.294897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:42.294897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:42.294897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 647/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:08:42.302520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3876fd-799e-4cce-961e-05f7139e9909 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:42.416684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3876fd-799e-4cce-961e-05f7139e9909 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:42.454162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bc74e-f31f-4c03-bf9d-72f4f0761f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:42.454828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bc74e-f31f-4c03-bf9d-72f4f0761f0c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:42.455105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bc74e-f31f-4c03-bf9d-72f4f0761f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:42.455379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bc74e-f31f-4c03-bf9d-72f4f0761f0c None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:42.456101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bc74e-f31f-4c03-bf9d-72f4f0761f0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:42.456403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bc74e-f31f-4c03-bf9d-72f4f0761f0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:42.457811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bc74e-f31f-4c03-bf9d-72f4f0761f0c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:42.470871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 632/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:42.476840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedd395-2882-432e-b0ac-feea6ea9b9de None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:42.509786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:42.599204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedd395-2882-432e-b0ac-feea6ea9b9de None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:42.638389 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690adaad-54f5-4188-94b5-44b22b4c4b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:42.639190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adaad-54f5-4188-94b5-44b22b4c4b87 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:42.639521 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adaad-54f5-4188-94b5-44b22b4c4b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:42.639813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adaad-54f5-4188-94b5-44b22b4c4b87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:42.647696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690adaad-54f5-4188-94b5-44b22b4c4b87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:42.649173 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690adaad-54f5-4188-94b5-44b22b4c4b87 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-690adaad-54f5-4188-94b5-44b22b4c4b87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:08:42.663531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:42.664613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:42.665707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 648/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:42.671264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bc74e-f31f-4c03-bf9d-72f4f0761f0c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:42.675546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:42.781018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bc74e-f31f-4c03-bf9d-72f4f0761f0c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:42.817190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bd49c-bc48-4a87-810b-5e6c2b731bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:42.817844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bd49c-bc48-4a87-810b-5e6c2b731bdf None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:42.818118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bd49c-bc48-4a87-810b-5e6c2b731bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:42.818391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bd49c-bc48-4a87-810b-5e6c2b731bdf None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:42.819222 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bd49c-bc48-4a87-810b-5e6c2b731bdf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:42.819532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bd49c-bc48-4a87-810b-5e6c2b731bdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:42.820968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bd49c-bc48-4a87-810b-5e6c2b731bdf None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:42.844349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 633/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jul 14 09:08:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:42.853807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690adaad-54f5-4188-94b5-44b22b4c4b87 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:42.955574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:42.966532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690adaad-54f5-4188-94b5-44b22b4c4b87 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:42.999612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e698b-97ad-44eb-8ea2-b7e08c2e2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:43.000248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e698b-97ad-44eb-8ea2-b7e08c2e2340 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:43.000532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e698b-97ad-44eb-8ea2-b7e08c2e2340 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:43.000843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e698b-97ad-44eb-8ea2-b7e08c2e2340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:43.071555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e698b-97ad-44eb-8ea2-b7e08c2e2340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:43.072951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e698b-97ad-44eb-8ea2-b7e08c2e2340 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:43.165614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:43.178117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 649/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jul 14 09:08:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:08:43.184201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bd49c-bc48-4a87-810b-5e6c2b731bdf None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:43.254059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:43.293677 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bd49c-bc48-4a87-810b-5e6c2b731bdf None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:43.330297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a976e1-10e1-4a55-8d48-cbbded6c55ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:43.331012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a976e1-10e1-4a55-8d48-cbbded6c55ea None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:43.331290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a976e1-10e1-4a55-8d48-cbbded6c55ea None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:43.331562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a976e1-10e1-4a55-8d48-cbbded6c55ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:43.342171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a976e1-10e1-4a55-8d48-cbbded6c55ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:43.343608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a976e1-10e1-4a55-8d48-cbbded6c55ea None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f5a976e1-10e1-4a55-8d48-cbbded6c55ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:08:43.361961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:43.362991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:43.363965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:08:43.363965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:08:43.363965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:08:43.363965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:43.363965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 634/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:43.369685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e698b-97ad-44eb-8ea2-b7e08c2e2340 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:43.485068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e698b-97ad-44eb-8ea2-b7e08c2e2340 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:43.521560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2e530-aa2e-4cbd-a56f-ff850d248ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:43.522214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2e530-aa2e-4cbd-a56f-ff850d248ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:43.522501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2e530-aa2e-4cbd-a56f-ff850d248ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:43.522775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2e530-aa2e-4cbd-a56f-ff850d248ab0 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:43.523497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2e530-aa2e-4cbd-a56f-ff850d248ab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:43.523806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2e530-aa2e-4cbd-a56f-ff850d248ab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:43.525222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2e530-aa2e-4cbd-a56f-ff850d248ab0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:43.537317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 650/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jul 14 09:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:43.546197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a976e1-10e1-4a55-8d48-cbbded6c55ea None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:43.650689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a976e1-10e1-4a55-8d48-cbbded6c55ea None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:43.665073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:43.688701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a5d3-cb55-4692-807a-8b157bac12b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:43.689521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a5d3-cb55-4692-807a-8b157bac12b8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:43.689808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a5d3-cb55-4692-807a-8b157bac12b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:43.690081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a5d3-cb55-4692-807a-8b157bac12b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:43.697110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6a5d3-cb55-4692-807a-8b157bac12b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:43.698565 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6a5d3-cb55-4692-807a-8b157bac12b8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-85a6a5d3-cb55-4692-807a-8b157bac12b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:08:43.712648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:43.713706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:43.714769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:08:43.714769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:08:43.714769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:08:43.714769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:08:43.714769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:08:43.714769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:08:43.714769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:08:43.714769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 14 09:08:43.714769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 635/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jul 14 09:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:43.720451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2e530-aa2e-4cbd-a56f-ff850d248ab0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:43.784698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:43.844951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2e530-aa2e-4cbd-a56f-ff850d248ab0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:43.879843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33266a14-bae4-47d8-ae87-ea7865e35810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:43.880493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33266a14-bae4-47d8-ae87-ea7865e35810 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:43.880792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33266a14-bae4-47d8-ae87-ea7865e35810 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:43.881068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33266a14-bae4-47d8-ae87-ea7865e35810 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:43.881850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33266a14-bae4-47d8-ae87-ea7865e35810 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:43.882154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33266a14-bae4-47d8-ae87-ea7865e35810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:43.883567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33266a14-bae4-47d8-ae87-ea7865e35810 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:43.895688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 651/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jul 14 09:08:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:43.905594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a5d3-cb55-4692-807a-8b157bac12b8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:44.009310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a5d3-cb55-4692-807a-8b157bac12b8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:44.044394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b30b26-f270-4f0b-bd86-b01ddaae1f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:44.045094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30b26-f270-4f0b-bd86-b01ddaae1f1c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:44.045371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30b26-f270-4f0b-bd86-b01ddaae1f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:44.045790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30b26-f270-4f0b-bd86-b01ddaae1f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:44.046561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b30b26-f270-4f0b-bd86-b01ddaae1f1c None admin] RBAC: Adding query filter params (role.id=6bfa68fd285f44978fab7051ae8d8f38, scope.project.id=7a3e3bae8f574e44a0782460fefc7162, user.id=58986e97f4d849aba35149d3666db015) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:44.046872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b30b26-f270-4f0b-bd86-b01ddaae1f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:44.048321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b30b26-f270-4f0b-bd86-b01ddaae1f1c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:44.054380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 636/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jul 14 09:08:43 2022] GET /identity/v3/role_assignments?user.id=58986e97f4d849aba35149d3666db015&scope.project.id=7a3e3bae8f574e44a0782460fefc7162&role.id=6bfa68fd285f44978fab7051ae8d8f38 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:46.070440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917bdef-f210-4ede-9134-6760ec9f2a89 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:46.071045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917bdef-f210-4ede-9134-6760ec9f2a89 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:46.071045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917bdef-f210-4ede-9134-6760ec9f2a89 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:46.072999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 652/1288] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:08:46.078524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c04e2-6597-499d-9abd-ebd55fcd251d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:46.079039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c04e2-6597-499d-9abd-ebd55fcd251d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:46.079039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c04e2-6597-499d-9abd-ebd55fcd251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:46.097941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ef9c04e2-6597-499d-9abd-ebd55fcd251d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:46.099116 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ef9c04e2-6597-499d-9abd-ebd55fcd251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:46.131603 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:46.183883 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 637/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:08:46.211842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917bdef-f210-4ede-9134-6760ec9f2a89 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:46.329117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917bdef-f210-4ede-9134-6760ec9f2a89 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:46.340140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:46.366048 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291187-289e-41d0-a053-cf888933451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:46.366849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291187-289e-41d0-a053-cf888933451b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:46.367128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291187-289e-41d0-a053-cf888933451b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:46.367395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291187-289e-41d0-a053-cf888933451b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:46.368045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291187-289e-41d0-a053-cf888933451b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:46.369426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291187-289e-41d0-a053-cf888933451b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-fc291187-289e-41d0-a053-cf888933451b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:46.382020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:46.383235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:46.384169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 653/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jul 14 09:08:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:46.389664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c04e2-6597-499d-9abd-ebd55fcd251d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:46.522376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c04e2-6597-499d-9abd-ebd55fcd251d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:46.566793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860d64d-dc17-4263-922e-b7f67449b996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:46.567444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d64d-dc17-4263-922e-b7f67449b996 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:46.567723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d64d-dc17-4263-922e-b7f67449b996 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:46.567995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d64d-dc17-4263-922e-b7f67449b996 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:46.568699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860d64d-dc17-4263-922e-b7f67449b996 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:46.569021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860d64d-dc17-4263-922e-b7f67449b996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:46.570382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860d64d-dc17-4263-922e-b7f67449b996 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:46.575846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 638/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jul 14 09:08:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:46.583112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291187-289e-41d0-a053-cf888933451b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:46.689846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291187-289e-41d0-a053-cf888933451b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:46.724927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4a7dc-384c-4269-b9ed-85c54ce7946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:46.725578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4a7dc-384c-4269-b9ed-85c54ce7946b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:46.725856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4a7dc-384c-4269-b9ed-85c54ce7946b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:46.726130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4a7dc-384c-4269-b9ed-85c54ce7946b None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:46.726830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4a7dc-384c-4269-b9ed-85c54ce7946b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:46.727132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4a7dc-384c-4269-b9ed-85c54ce7946b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:46.728483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4a7dc-384c-4269-b9ed-85c54ce7946b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:46.733057 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 654/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jul 14 09:08:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:48.755483 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb35b3-6801-40eb-8890-6f1a142b8efa None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:48.756057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb35b3-6801-40eb-8890-6f1a142b8efa None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:48.756057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb35b3-6801-40eb-8890-6f1a142b8efa None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:48.757445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 639/1293] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:08:48.763634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301406bf-26bc-44ba-8f7b-9ff828b9ba51 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:48.764339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301406bf-26bc-44ba-8f7b-9ff828b9ba51 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:48.764488 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301406bf-26bc-44ba-8f7b-9ff828b9ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:48.783785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-301406bf-26bc-44ba-8f7b-9ff828b9ba51 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:48.785008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-301406bf-26bc-44ba-8f7b-9ff828b9ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:48.815887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:48.856259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 655/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:08:48.880228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb35b3-6801-40eb-8890-6f1a142b8efa None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:48.912701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:48.986515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb35b3-6801-40eb-8890-6f1a142b8efa None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:49.022046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc75580-1654-4c46-9091-60fce290afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:49.022624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75580-1654-4c46-9091-60fce290afcf None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:49.022903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75580-1654-4c46-9091-60fce290afcf None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:49.023174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75580-1654-4c46-9091-60fce290afcf None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:49.023888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc75580-1654-4c46-9091-60fce290afcf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:49.025288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc75580-1654-4c46-9091-60fce290afcf None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:49.041678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 640/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jul 14 09:08:48 2022] POST /identity/v3/services => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:08:51.035021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e7a4-d965-4fbe-9b61-adf58a26afe9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:51.035919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e7a4-d965-4fbe-9b61-adf58a26afe9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:51.035919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8e7a4-d965-4fbe-9b61-adf58a26afe9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:51.038120 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 656/1296] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:08:51.043469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff105b-d5e3-4c44-bc06-0bdd7c08d998 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:51.043909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff105b-d5e3-4c44-bc06-0bdd7c08d998 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:51.044018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff105b-d5e3-4c44-bc06-0bdd7c08d998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:51.061475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-daff105b-d5e3-4c44-bc06-0bdd7c08d998 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:51.062656 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-daff105b-d5e3-4c44-bc06-0bdd7c08d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:51.142918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 641/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:08:51.176113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8e7a4-d965-4fbe-9b61-adf58a26afe9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:51.290293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8e7a4-d965-4fbe-9b61-adf58a26afe9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:51.332496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c84aa-0498-4de3-a2e7-f4e16816e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:51.333736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c84aa-0498-4de3-a2e7-f4e16816e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:51.334176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c84aa-0498-4de3-a2e7-f4e16816e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:51.334613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c84aa-0498-4de3-a2e7-f4e16816e4d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:51.335665 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c84aa-0498-4de3-a2e7-f4e16816e4d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:51.337884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c84aa-0498-4de3-a2e7-f4e16816e4d6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-ac9c84aa-0498-4de3-a2e7-f4e16816e4d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:51.352506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:51.353683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:51.354529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 657/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jul 14 09:08:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:08:51.360267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff105b-d5e3-4c44-bc06-0bdd7c08d998 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:51.380748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:51.468855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff105b-d5e3-4c44-bc06-0bdd7c08d998 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:51.505402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc35b8-a1e6-410a-9606-fd9118417f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:51.506055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc35b8-a1e6-410a-9606-fd9118417f49 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:51.506337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc35b8-a1e6-410a-9606-fd9118417f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:51.506611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc35b8-a1e6-410a-9606-fd9118417f49 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:51.507316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc35b8-a1e6-410a-9606-fd9118417f49 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:51.507630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc35b8-a1e6-410a-9606-fd9118417f49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:51.509019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc35b8-a1e6-410a-9606-fd9118417f49 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:51.514323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 642/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jul 14 09:08:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:51.524187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c84aa-0498-4de3-a2e7-f4e16816e4d6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:51.560099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:51.634695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c84aa-0498-4de3-a2e7-f4e16816e4d6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:51.669669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993a40b-204f-4f03-a461-463d60e28647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:51.670339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993a40b-204f-4f03-a461-463d60e28647 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:51.670624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993a40b-204f-4f03-a461-463d60e28647 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:51.670879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993a40b-204f-4f03-a461-463d60e28647 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:51.671819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993a40b-204f-4f03-a461-463d60e28647 None admin] RBAC: Adding query filter params (interface=public, service_id=6eaffcce8615486daed37e1a0c5640f2, region_id=RegionOne) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:51.672134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993a40b-204f-4f03-a461-463d60e28647 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:51.673588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993a40b-204f-4f03-a461-463d60e28647 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:51.678848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 658/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jul 14 09:08:51 2022] GET /identity/v3/endpoints?service_id=6eaffcce8615486daed37e1a0c5640f2&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:51.685034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc35b8-a1e6-410a-9606-fd9118417f49 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:51.770608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:51.792207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc35b8-a1e6-410a-9606-fd9118417f49 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:51.829059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7469-2a54-499e-bcf5-d5196762bf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:51.829658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7469-2a54-499e-bcf5-d5196762bf4f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:51.829955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7469-2a54-499e-bcf5-d5196762bf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:51.830227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7469-2a54-499e-bcf5-d5196762bf4f None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:51.830906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d7469-2a54-499e-bcf5-d5196762bf4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:51.832265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d7469-2a54-499e-bcf5-d5196762bf4f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:51.839309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 643/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jul 14 09:08:51 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:08:53.818500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d199-f985-42fb-b338-8983e8be8771 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:53.819071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d199-f985-42fb-b338-8983e8be8771 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:53.819071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d199-f985-42fb-b338-8983e8be8771 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:53.821268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 659/1302] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:08:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:08:53.829320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b7dc2-7fbd-44e1-8b71-3f1a1d261814 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:53.829771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b7dc2-7fbd-44e1-8b71-3f1a1d261814 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:53.829897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b7dc2-7fbd-44e1-8b71-3f1a1d261814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:53.847668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-315b7dc2-7fbd-44e1-8b71-3f1a1d261814 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:08:53.848875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-315b7dc2-7fbd-44e1-8b71-3f1a1d261814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:08:53.917701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 644/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:08:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:08:53.941956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29d199-f985-42fb-b338-8983e8be8771 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:54.060347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:54.072791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29d199-f985-42fb-b338-8983e8be8771 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:54.111287 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e042f2-91d5-403a-8801-67a948758f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:54.112086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e042f2-91d5-403a-8801-67a948758f1c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:54.112367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e042f2-91d5-403a-8801-67a948758f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:54.112624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e042f2-91d5-403a-8801-67a948758f1c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:54.113317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e042f2-91d5-403a-8801-67a948758f1c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:54.114682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e042f2-91d5-403a-8801-67a948758f1c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-53e042f2-91d5-403a-8801-67a948758f1c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:08:54.126486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:08:54.127845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 14 09:08:54.128865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 660/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jul 14 09:08:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:08:54.136934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b7dc2-7fbd-44e1-8b71-3f1a1d261814 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:54.227200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:08:54.252872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b7dc2-7fbd-44e1-8b71-3f1a1d261814 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:54.289200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68748b-35dd-4fa8-83a4-ae9daf2c8d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:54.289853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68748b-35dd-4fa8-83a4-ae9daf2c8d56 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:54.290135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68748b-35dd-4fa8-83a4-ae9daf2c8d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:54.290401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68748b-35dd-4fa8-83a4-ae9daf2c8d56 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:54.291112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68748b-35dd-4fa8-83a4-ae9daf2c8d56 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:08:54.291404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68748b-35dd-4fa8-83a4-ae9daf2c8d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:54.292788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68748b-35dd-4fa8-83a4-ae9daf2c8d56 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:54.298320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 645/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jul 14 09:08:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:08:54.304923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e042f2-91d5-403a-8801-67a948758f1c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:08:54.414238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e042f2-91d5-403a-8801-67a948758f1c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:08:54.454608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fc036-e42f-4dc3-b8b2-84e570c61370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:08:54.455497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fc036-e42f-4dc3-b8b2-84e570c61370 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:08:54.455876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fc036-e42f-4dc3-b8b2-84e570c61370 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:08:54.456240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fc036-e42f-4dc3-b8b2-84e570c61370 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:08:54.457419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fc036-e42f-4dc3-b8b2-84e570c61370 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:08:54.459528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fc036-e42f-4dc3-b8b2-84e570c61370 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:08:54.484966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 661/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jul 14 09:08:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:09:04.295051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=30 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:09:04.480372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:09:57.516238 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680bb3a-76dd-4316-90dd-234cf930546d None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:09:57.516950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680bb3a-76dd-4316-90dd-234cf930546d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:09:57.516950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680bb3a-76dd-4316-90dd-234cf930546d None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:09:57.524008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b577ff-60fb-45a0-935b-41741f091075 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:09:57.524537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b577ff-60fb-45a0-935b-41741f091075 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:09:57.524537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b577ff-60fb-45a0-935b-41741f091075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:09:57.526683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 646/1307] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:09:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:09:57.597240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-16b577ff-60fb-45a0-935b-41741f091075 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:09:57.598455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-16b577ff-60fb-45a0-935b-41741f091075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:09:57.724867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 662/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:09:57.761488 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55ff78-bbbe-4b82-8185-53772f62ba60 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:09:57.762184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55ff78-bbbe-4b82-8185-53772f62ba60 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:09:57.763330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55ff78-bbbe-4b82-8185-53772f62ba60 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:09:57.765176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 647/1309] 10.222.0.27 () {54 vars in 964 bytes} [Thu Jul 14 09:09:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:09:57.771975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dbbaa-b8f2-4a42-a972-84f5ab2416ec None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:09:57.772165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dbbaa-b8f2-4a42-a972-84f5ab2416ec None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:09:57.772443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dbbaa-b8f2-4a42-a972-84f5ab2416ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:09:57.869915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ac5dbbaa-b8f2-4a42-a972-84f5ab2416ec None None] MFA Rules not processed for user `60db5d8bc4cb4ce7af8bfac2c4eb2390`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:09:57.871138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ac5dbbaa-b8f2-4a42-a972-84f5ab2416ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:09:57.893738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:09:57.963723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 663/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Thu Jul 14 09:09:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:09:57.964579 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55ff78-bbbe-4b82-8185-53772f62ba60 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:09:57.966765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cc55ff78-bbbe-4b82-8185-53772f62ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:09:58.142342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55ff78-bbbe-4b82-8185-53772f62ba60 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:09:58.226338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1289c-21b5-47d1-a460-2ebf2af62ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:09:58.226997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1289c-21b5-47d1-a460-2ebf2af62ffc service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:09:58.227284 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1289c-21b5-47d1-a460-2ebf2af62ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:09:58.227556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1289c-21b5-47d1-a460-2ebf2af62ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:09:58.229240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5da1289c-21b5-47d1-a460-2ebf2af62ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:09:58.287412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:09:58.348494 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1289c-21b5-47d1-a460-2ebf2af62ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:09:58.349991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1289c-21b5-47d1-a460-2ebf2af62ffc service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:09:58.377495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 648/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:10:00.723310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dfbcf-a692-4186-a3b3-4bb86dfeeb8c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:00.723873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dfbcf-a692-4186-a3b3-4bb86dfeeb8c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:00.723873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dfbcf-a692-4186-a3b3-4bb86dfeeb8c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:00.725457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 664/1312] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:00.730675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bb3b7-e08a-4949-83f9-24b93e78a5f3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:00.731138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bb3b7-e08a-4949-83f9-24b93e78a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:00.731228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bb3b7-e08a-4949-83f9-24b93e78a5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:00.826408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-778bb3b7-e08a-4949-83f9-24b93e78a5f3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:00.827877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-778bb3b7-e08a-4949-83f9-24b93e78a5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:00.951095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 649/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:00.994987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dfbcf-a692-4186-a3b3-4bb86dfeeb8c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:00.996733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-de6dfbcf-a692-4186-a3b3-4bb86dfeeb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:01.112730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dfbcf-a692-4186-a3b3-4bb86dfeeb8c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:01.192580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:01.195796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfa507-a4a8-4ae1-8377-1575eaf59499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:01.196750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfa507-a4a8-4ae1-8377-1575eaf59499 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:01.197451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfa507-a4a8-4ae1-8377-1575eaf59499 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:01.198014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfa507-a4a8-4ae1-8377-1575eaf59499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:01.200546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6dbfa507-a4a8-4ae1-8377-1575eaf59499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:01.322197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfa507-a4a8-4ae1-8377-1575eaf59499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:01.323644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfa507-a4a8-4ae1-8377-1575eaf59499 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:01.344033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 665/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:03.657031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495ba7f-bc2a-4239-9cb9-c4a419702ebe None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:03.657634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495ba7f-bc2a-4239-9cb9-c4a419702ebe None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:03.657634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495ba7f-bc2a-4239-9cb9-c4a419702ebe None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:03.658975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 650/1315] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:03.664550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eaf9a-62c6-4cec-a9e4-eefbd18b8894 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:03.665008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eaf9a-62c6-4cec-a9e4-eefbd18b8894 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:03.665100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eaf9a-62c6-4cec-a9e4-eefbd18b8894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:03.736514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-290eaf9a-62c6-4cec-a9e4-eefbd18b8894 None None] MFA Rules not processed for user `1829e1ee957144f7aae3cc64ec22ab1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:03.738004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-290eaf9a-62c6-4cec-a9e4-eefbd18b8894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:03.793115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:03.847816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 666/1316] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:03.895739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495ba7f-bc2a-4239-9cb9-c4a419702ebe None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:03.897347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1495ba7f-bc2a-4239-9cb9-c4a419702ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:03.908218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:04.010867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495ba7f-bc2a-4239-9cb9-c4a419702ebe None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:04.094698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2895c23-237d-4eea-bcde-8eb085f1857b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:04.095350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2895c23-237d-4eea-bcde-8eb085f1857b service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:04.095632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2895c23-237d-4eea-bcde-8eb085f1857b service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:04.095904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2895c23-237d-4eea-bcde-8eb085f1857b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:04.097828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d2895c23-237d-4eea-bcde-8eb085f1857b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:04.169608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:04.231934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2895c23-237d-4eea-bcde-8eb085f1857b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:04.233424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2895c23-237d-4eea-bcde-8eb085f1857b service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:04.252461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 651/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:06.847678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615365a2-1409-4ab6-bf78-b400011e4812 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:06.848242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615365a2-1409-4ab6-bf78-b400011e4812 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:06.848242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615365a2-1409-4ab6-bf78-b400011e4812 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:06.849654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 667/1318] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:06.855950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccc98a-fc6b-48ad-b439-a8f5ce4d4b4c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:06.856656 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccc98a-fc6b-48ad-b439-a8f5ce4d4b4c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:06.856889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccc98a-fc6b-48ad-b439-a8f5ce4d4b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:06.927262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5bccc98a-fc6b-48ad-b439-a8f5ce4d4b4c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:06.928453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5bccc98a-fc6b-48ad-b439-a8f5ce4d4b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:07.031271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 652/1319] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:07.070654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615365a2-1409-4ab6-bf78-b400011e4812 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:07.072209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-615365a2-1409-4ab6-bf78-b400011e4812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:07.188093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615365a2-1409-4ab6-bf78-b400011e4812 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:07.263733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0700399-555a-4946-8ed2-95ca697cd48b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:07.264371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0700399-555a-4946-8ed2-95ca697cd48b service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:07.264641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0700399-555a-4946-8ed2-95ca697cd48b service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:07.264942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0700399-555a-4946-8ed2-95ca697cd48b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:07.266577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e0700399-555a-4946-8ed2-95ca697cd48b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:07.274166 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:07.394654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0700399-555a-4946-8ed2-95ca697cd48b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:07.396117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0700399-555a-4946-8ed2-95ca697cd48b service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:07.414787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 668/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:10.104034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6246f3-72d4-4da3-9ebb-636ec985ec33 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:10.104612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6246f3-72d4-4da3-9ebb-636ec985ec33 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:10.104612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6246f3-72d4-4da3-9ebb-636ec985ec33 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:10.106001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 653/1321] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:10.111349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790cb8f-44e5-47c2-9fe4-1c15784dea40 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:10.111760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790cb8f-44e5-47c2-9fe4-1c15784dea40 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:10.111914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790cb8f-44e5-47c2-9fe4-1c15784dea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:10.180825 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b790cb8f-44e5-47c2-9fe4-1c15784dea40 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:10.182045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b790cb8f-44e5-47c2-9fe4-1c15784dea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:10.246102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:10.296772 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 669/1322] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:10:10.345559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b7aa-61a0-4144-b9ee-4558dd7a4ff4 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:10.345832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b7aa-61a0-4144-b9ee-4558dd7a4ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:10.346142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b7aa-61a0-4144-b9ee-4558dd7a4ff4 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:10.347705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 654/1323] 10.222.0.27 () {54 vars in 964 bytes} [Thu Jul 14 09:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:10.354277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785a74-4555-48da-9d86-e8ea62ecd983 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:10.354500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785a74-4555-48da-9d86-e8ea62ecd983 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:10.354778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785a74-4555-48da-9d86-e8ea62ecd983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:10.439798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f0785a74-4555-48da-9d86-e8ea62ecd983 None None] MFA Rules not processed for user `60db5d8bc4cb4ce7af8bfac2c4eb2390`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:10.441137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f0785a74-4555-48da-9d86-e8ea62ecd983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:10.526100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 670/1324] 10.222.0.27 () {58 vars in 1061 bytes} [Thu Jul 14 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:10.535161 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733b7aa-61a0-4144-b9ee-4558dd7a4ff4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:10.536818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0733b7aa-61a0-4144-b9ee-4558dd7a4ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:10.557422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:10.645182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733b7aa-61a0-4144-b9ee-4558dd7a4ff4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:10.723492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4d96f-40a5-4c5e-abf3-7801e4b0d96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:10.724142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4d96f-40a5-4c5e-abf3-7801e4b0d96a service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:10.724420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4d96f-40a5-4c5e-abf3-7801e4b0d96a service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:10.724728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4d96f-40a5-4c5e-abf3-7801e4b0d96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:10.726367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2cd4d96f-40a5-4c5e-abf3-7801e4b0d96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:10.802907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:10.842634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4d96f-40a5-4c5e-abf3-7801e4b0d96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:10.844075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4d96f-40a5-4c5e-abf3-7801e4b0d96a service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:10.862593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 655/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:13.155900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825756-1c5b-4eb8-a15f-e763325d4a7e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:13.156449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825756-1c5b-4eb8-a15f-e763325d4a7e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:13.156449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825756-1c5b-4eb8-a15f-e763325d4a7e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:13.158147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 671/1326] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:13.163669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47001661-d32e-4b33-b6dd-e27eb6616560 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:13.164137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47001661-d32e-4b33-b6dd-e27eb6616560 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:13.164240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47001661-d32e-4b33-b6dd-e27eb6616560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:13.237010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-47001661-d32e-4b33-b6dd-e27eb6616560 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:13.238319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-47001661-d32e-4b33-b6dd-e27eb6616560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:13.346849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 656/1327] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:13.384682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825756-1c5b-4eb8-a15f-e763325d4a7e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:13.386249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5d825756-1c5b-4eb8-a15f-e763325d4a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:13.450058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:13.496104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825756-1c5b-4eb8-a15f-e763325d4a7e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:13.577775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28801096-cf72-4bb1-81be-559c83f00a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:13.578323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801096-cf72-4bb1-81be-559c83f00a3c service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:13.578607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801096-cf72-4bb1-81be-559c83f00a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:13.578882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801096-cf72-4bb1-81be-559c83f00a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:13.580537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-28801096-cf72-4bb1-81be-559c83f00a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:13.692101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:13.695062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28801096-cf72-4bb1-81be-559c83f00a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:13.696622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28801096-cf72-4bb1-81be-559c83f00a3c service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:13.715960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 672/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:15.790598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38423abe-d43c-4cdd-aeb6-ae8fe7d84150 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:15.791150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38423abe-d43c-4cdd-aeb6-ae8fe7d84150 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:15.791150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38423abe-d43c-4cdd-aeb6-ae8fe7d84150 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:15.792552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 657/1329] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:15.797895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd131e-e430-4f6e-b0d0-0ed150ae765a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:15.798307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd131e-e430-4f6e-b0d0-0ed150ae765a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:15.798655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd131e-e430-4f6e-b0d0-0ed150ae765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:15.888184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c6dd131e-e430-4f6e-b0d0-0ed150ae765a None None] MFA Rules not processed for user `1829e1ee957144f7aae3cc64ec22ab1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:15.889432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c6dd131e-e430-4f6e-b0d0-0ed150ae765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:15.990896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 673/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:16.033576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38423abe-d43c-4cdd-aeb6-ae8fe7d84150 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:16.035198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-38423abe-d43c-4cdd-aeb6-ae8fe7d84150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:16.072567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:16.162603 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38423abe-d43c-4cdd-aeb6-ae8fe7d84150 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:16.240264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2c31a-f1f2-4ae1-98f1-db6e9f44d7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:16.241235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2c31a-f1f2-4ae1-98f1-db6e9f44d7cb service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:16.241622 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2c31a-f1f2-4ae1-98f1-db6e9f44d7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:16.241957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2c31a-f1f2-4ae1-98f1-db6e9f44d7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:16.244655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ccb2c31a-f1f2-4ae1-98f1-db6e9f44d7cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:16.334580 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:16.380709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2c31a-f1f2-4ae1-98f1-db6e9f44d7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:16.382184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2c31a-f1f2-4ae1-98f1-db6e9f44d7cb service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:16.403211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 658/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:18.814642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634199b9-d4c4-463e-a83e-570dbd98c448 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:18.815420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634199b9-d4c4-463e-a83e-570dbd98c448 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:18.815420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634199b9-d4c4-463e-a83e-570dbd98c448 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:18.817270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 674/1332] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:18.825749 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cc980-891a-4910-8cca-0346d41de11c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:18.826210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cc980-891a-4910-8cca-0346d41de11c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:18.826327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cc980-891a-4910-8cca-0346d41de11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:18.897763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-201cc980-891a-4910-8cca-0346d41de11c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:18.898962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-201cc980-891a-4910-8cca-0346d41de11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:19.001914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 659/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:19.040436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634199b9-d4c4-463e-a83e-570dbd98c448 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:19.042842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-634199b9-d4c4-463e-a83e-570dbd98c448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:19.126813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:19.168677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634199b9-d4c4-463e-a83e-570dbd98c448 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:19.245458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4795e-fa46-492b-b234-38117c4de884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:19.246118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4795e-fa46-492b-b234-38117c4de884 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:19.246394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4795e-fa46-492b-b234-38117c4de884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:19.246667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4795e-fa46-492b-b234-38117c4de884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:19.248369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c3c4795e-fa46-492b-b234-38117c4de884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:19.363292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4795e-fa46-492b-b234-38117c4de884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:19.364832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4795e-fa46-492b-b234-38117c4de884 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:19.377413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:19.386929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 675/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:21.429747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e24536-70f3-41d5-bb28-52b5db9adf7c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:21.430614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e24536-70f3-41d5-bb28-52b5db9adf7c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:21.430614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e24536-70f3-41d5-bb28-52b5db9adf7c None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:21.432903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 660/1335] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:21.441657 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd011e1-4bd4-4ac5-b842-1e82e0c2448d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:21.442225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd011e1-4bd4-4ac5-b842-1e82e0c2448d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:21.442543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd011e1-4bd4-4ac5-b842-1e82e0c2448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:21.509735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0cd011e1-4bd4-4ac5-b842-1e82e0c2448d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:21.510951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0cd011e1-4bd4-4ac5-b842-1e82e0c2448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:21.623311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 676/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:21.665641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e24536-70f3-41d5-bb28-52b5db9adf7c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:21.667944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-27e24536-70f3-41d5-bb28-52b5db9adf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:21.711599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:21.779526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e24536-70f3-41d5-bb28-52b5db9adf7c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:21.855976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba763f4-d6a1-4e63-a0c0-b66a63d48a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:21.856616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba763f4-d6a1-4e63-a0c0-b66a63d48a97 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:21.856927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba763f4-d6a1-4e63-a0c0-b66a63d48a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:21.857199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba763f4-d6a1-4e63-a0c0-b66a63d48a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:21.858831 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5ba763f4-d6a1-4e63-a0c0-b66a63d48a97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:21.944894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:21.972272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba763f4-d6a1-4e63-a0c0-b66a63d48a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:21.974101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba763f4-d6a1-4e63-a0c0-b66a63d48a97 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:21.992207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 661/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:24.451991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199a223-7159-4aa4-9703-3aa7fefc54bf None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:24.452574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199a223-7159-4aa4-9703-3aa7fefc54bf None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:24.452574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199a223-7159-4aa4-9703-3aa7fefc54bf None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:24.453941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 677/1338] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:24.460572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15d98-02b3-43d6-9c72-5d54cb443340 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:24.461050 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15d98-02b3-43d6-9c72-5d54cb443340 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:24.461194 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15d98-02b3-43d6-9c72-5d54cb443340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:24.534466 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-31f15d98-02b3-43d6-9c72-5d54cb443340 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:24.535761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-31f15d98-02b3-43d6-9c72-5d54cb443340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:24.637033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 662/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:24.675499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199a223-7159-4aa4-9703-3aa7fefc54bf None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:24.677130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1199a223-7159-4aa4-9703-3aa7fefc54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:24.768634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:24.799177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199a223-7159-4aa4-9703-3aa7fefc54bf None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:24.877792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764cc02-0801-4e3b-b2d0-7f994818abac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:24.878435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764cc02-0801-4e3b-b2d0-7f994818abac service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:24.878721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764cc02-0801-4e3b-b2d0-7f994818abac service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:24.878984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764cc02-0801-4e3b-b2d0-7f994818abac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:24.881004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5764cc02-0801-4e3b-b2d0-7f994818abac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:25.008064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764cc02-0801-4e3b-b2d0-7f994818abac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:25.009871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764cc02-0801-4e3b-b2d0-7f994818abac service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:25.033428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 678/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:29.068297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763887fb-5102-475f-8cdb-57107a6cc20f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:29.068909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763887fb-5102-475f-8cdb-57107a6cc20f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:29.068909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763887fb-5102-475f-8cdb-57107a6cc20f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:29.070382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 663/1341] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:29.075909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47748-939d-4cd6-9fdf-05396485a5c3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:29.076349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47748-939d-4cd6-9fdf-05396485a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:29.076444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47748-939d-4cd6-9fdf-05396485a5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:29.081143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:29.148621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f1c47748-939d-4cd6-9fdf-05396485a5c3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:29.149763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f1c47748-939d-4cd6-9fdf-05396485a5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:29.256330 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 679/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:29.294491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763887fb-5102-475f-8cdb-57107a6cc20f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:29.296091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-763887fb-5102-475f-8cdb-57107a6cc20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:29.346920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:29.406555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763887fb-5102-475f-8cdb-57107a6cc20f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:29.485847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ab796-0c01-4ca8-8b4c-62deb8ec04c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:29.486511 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ab796-0c01-4ca8-8b4c-62deb8ec04c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:29.486796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ab796-0c01-4ca8-8b4c-62deb8ec04c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:29.487069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ab796-0c01-4ca8-8b4c-62deb8ec04c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:29.488770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7a8ab796-0c01-4ca8-8b4c-62deb8ec04c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:29.589951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:29.611641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ab796-0c01-4ca8-8b4c-62deb8ec04c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:29.613144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ab796-0c01-4ca8-8b4c-62deb8ec04c5 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:29.633439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 664/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:32.608553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebdd4e-513f-40d0-9a90-4be53e927f74 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:32.609130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebdd4e-513f-40d0-9a90-4be53e927f74 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:32.609130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebdd4e-513f-40d0-9a90-4be53e927f74 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:32.610713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 680/1344] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:32.616425 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bf3e0-27c2-42fb-8f50-090a2d047d35 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:32.616894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bf3e0-27c2-42fb-8f50-090a2d047d35 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:32.617029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bf3e0-27c2-42fb-8f50-090a2d047d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:32.685402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-159bf3e0-27c2-42fb-8f50-090a2d047d35 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:32.686612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-159bf3e0-27c2-42fb-8f50-090a2d047d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:32.793004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 665/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:32.829733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebdd4e-513f-40d0-9a90-4be53e927f74 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:32.831253 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f9ebdd4e-513f-40d0-9a90-4be53e927f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:32.921275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:32.939834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebdd4e-513f-40d0-9a90-4be53e927f74 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:33.023743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b4d3a-dd4f-40cf-87b8-77fe6332d895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:33.024401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b4d3a-dd4f-40cf-87b8-77fe6332d895 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:33.024699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b4d3a-dd4f-40cf-87b8-77fe6332d895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:33.024972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b4d3a-dd4f-40cf-87b8-77fe6332d895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:33.026620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a77b4d3a-dd4f-40cf-87b8-77fe6332d895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:33.145152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b4d3a-dd4f-40cf-87b8-77fe6332d895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:33.147324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b4d3a-dd4f-40cf-87b8-77fe6332d895 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:33.172509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 681/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:37.287072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9963941-6e5f-435e-8257-478bebaf6886 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:37.287538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9963941-6e5f-435e-8257-478bebaf6886 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:37.287643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9963941-6e5f-435e-8257-478bebaf6886 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:37.290043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 666/1347] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:37.294598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd0486-5cdd-4817-a5be-43f0948a0f50 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:37.295039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd0486-5cdd-4817-a5be-43f0948a0f50 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:37.295183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd0486-5cdd-4817-a5be-43f0948a0f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:37.310450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:37.371608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6dfd0486-5cdd-4817-a5be-43f0948a0f50 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:37.373198 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6dfd0486-5cdd-4817-a5be-43f0948a0f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:37.486332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 682/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:37.523760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9963941-6e5f-435e-8257-478bebaf6886 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:37.525328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d9963941-6e5f-435e-8257-478bebaf6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:37.587029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:37.638331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9963941-6e5f-435e-8257-478bebaf6886 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:37.715961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442363a-13aa-4fb5-adc4-cdb878a1fa49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:37.716578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442363a-13aa-4fb5-adc4-cdb878a1fa49 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:37.716900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442363a-13aa-4fb5-adc4-cdb878a1fa49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:37.717172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442363a-13aa-4fb5-adc4-cdb878a1fa49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:37.718821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5442363a-13aa-4fb5-adc4-cdb878a1fa49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:37.851198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:37.856318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442363a-13aa-4fb5-adc4-cdb878a1fa49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:37.858960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442363a-13aa-4fb5-adc4-cdb878a1fa49 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:37.886124 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 667/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:42.746431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b577-b09f-4f17-8fa0-4fd86159e81f None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:42.746971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b577-b09f-4f17-8fa0-4fd86159e81f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:42.746971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b577-b09f-4f17-8fa0-4fd86159e81f None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:42.748377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 683/1350] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:42.767551 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5c06-cf0f-4cd0-865f-ef6d2cdf7cb7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:42.768511 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5c06-cf0f-4cd0-865f-ef6d2cdf7cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:42.769039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5c06-cf0f-4cd0-865f-ef6d2cdf7cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:42.859583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-812f5c06-cf0f-4cd0-865f-ef6d2cdf7cb7 None None] MFA Rules not processed for user `58986e97f4d849aba35149d3666db015`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:42.861149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-812f5c06-cf0f-4cd0-865f-ef6d2cdf7cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:42.973781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 668/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:10:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:47.014283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ba5ef-2289-41c4-aac0-96c32bde28c6 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:47.014824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ba5ef-2289-41c4-aac0-96c32bde28c6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:47.014824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ba5ef-2289-41c4-aac0-96c32bde28c6 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:47.016385 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 684/1352] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:47.021645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b046-64eb-46a7-9162-28581e39fd0f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:47.022559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b046-64eb-46a7-9162-28581e39fd0f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:47.023020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b046-64eb-46a7-9162-28581e39fd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:47.083543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:47.110216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2228b046-64eb-46a7-9162-28581e39fd0f None None] MFA Rules not processed for user `58986e97f4d849aba35149d3666db015`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:47.112451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2228b046-64eb-46a7-9162-28581e39fd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:47.241829 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 669/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:10:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:47.484169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=59 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:48.604264 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d08d8-5627-4b80-bf96-61e8c4543e5a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:48.604945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d08d8-5627-4b80-bf96-61e8c4543e5a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:48.604945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d08d8-5627-4b80-bf96-61e8c4543e5a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:48.606299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 685/1354] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:48.611248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338be81-d2de-46be-a685-2a42110f56a2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:48.611659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338be81-d2de-46be-a685-2a42110f56a2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:48.611786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338be81-d2de-46be-a685-2a42110f56a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:48.689424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1338be81-d2de-46be-a685-2a42110f56a2 None None] MFA Rules not processed for user `58986e97f4d849aba35149d3666db015`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:48.690885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1338be81-d2de-46be-a685-2a42110f56a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:48.737158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:48.804064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 670/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:10:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:52.377800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b2d4-76fd-4bd3-9921-6ba0657cfbdd None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:52.378738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b2d4-76fd-4bd3-9921-6ba0657cfbdd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:52.379412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b2d4-76fd-4bd3-9921-6ba0657cfbdd None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:52.381098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 686/1356] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:52.387606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f35358-877a-4352-92c6-ed22492ccac8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:52.388501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f35358-877a-4352-92c6-ed22492ccac8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:52.388917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f35358-877a-4352-92c6-ed22492ccac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:52.461969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-95f35358-877a-4352-92c6-ed22492ccac8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:52.463325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-95f35358-877a-4352-92c6-ed22492ccac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:52.568045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 671/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:52.622743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64f6b-970d-4ee3-9d86-3f4b1c63511b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:52.623026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64f6b-970d-4ee3-9d86-3f4b1c63511b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:52.623297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64f6b-970d-4ee3-9d86-3f4b1c63511b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:52.624645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 687/1358] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jul 14 09:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:52.632951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9b3a-5fd5-453e-ac1a-2064e75ddaa4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:52.633347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9b3a-5fd5-453e-ac1a-2064e75ddaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:52.633530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9b3a-5fd5-453e-ac1a-2064e75ddaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:52.654359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:52.718925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9f9d9b3a-5fd5-453e-ac1a-2064e75ddaa4 None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:52.720030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9f9d9b3a-5fd5-453e-ac1a-2064e75ddaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:52.862737 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 672/1359] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jul 14 09:10:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:52.871225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e64f6b-970d-4ee3-9d86-3f4b1c63511b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:52.872893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-03e64f6b-970d-4ee3-9d86-3f4b1c63511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:53.022884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e64f6b-970d-4ee3-9d86-3f4b1c63511b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:53.102620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:53.146535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd7ab4-2c20-4b1c-983c-6d183dcc3a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:53.147241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd7ab4-2c20-4b1c-983c-6d183dcc3a96 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:53.147517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd7ab4-2c20-4b1c-983c-6d183dcc3a96 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:53.147802 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd7ab4-2c20-4b1c-983c-6d183dcc3a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:53.149478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d4bd7ab4-2c20-4b1c-983c-6d183dcc3a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:53.247395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd7ab4-2c20-4b1c-983c-6d183dcc3a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:53.249112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd7ab4-2c20-4b1c-983c-6d183dcc3a96 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:53.269249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 688/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:55.482129 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a69b-9f23-403c-af7e-743ba0582568 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:55.482735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a69b-9f23-403c-af7e-743ba0582568 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:55.482735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a69b-9f23-403c-af7e-743ba0582568 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:55.484264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 673/1361] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:55.489530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b205d0-4890-44c6-8939-abf585539875 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:55.489993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b205d0-4890-44c6-8939-abf585539875 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:55.490076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b205d0-4890-44c6-8939-abf585539875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:55.561660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d8b205d0-4890-44c6-8939-abf585539875 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:55.563035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d8b205d0-4890-44c6-8939-abf585539875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:55.610047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:55.696903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 689/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:55.743470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a69b-9f23-403c-af7e-743ba0582568 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:55.745031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8b42a69b-9f23-403c-af7e-743ba0582568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:55.816365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:55.939794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a69b-9f23-403c-af7e-743ba0582568 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:56.071139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903264d5-e5de-45ad-ad4d-66d452854282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:56.071819 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903264d5-e5de-45ad-ad4d-66d452854282 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:56.072095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903264d5-e5de-45ad-ad4d-66d452854282 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:56.072375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903264d5-e5de-45ad-ad4d-66d452854282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:56.074107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-903264d5-e5de-45ad-ad4d-66d452854282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:56.099797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:56.173683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903264d5-e5de-45ad-ad4d-66d452854282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:56.175295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903264d5-e5de-45ad-ad4d-66d452854282 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:56.196618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 674/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:10:58.531062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea22a0-a2dc-467e-beb4-582a6297a9d3 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:58.532166 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea22a0-a2dc-467e-beb4-582a6297a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:58.532769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea22a0-a2dc-467e-beb4-582a6297a9d3 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:58.534441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 690/1364] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:10:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:10:58.540408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cd0f3-1834-43ea-b592-33cca7b65179 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:58.541376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cd0f3-1834-43ea-b592-33cca7b65179 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:58.541859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cd0f3-1834-43ea-b592-33cca7b65179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:58.608370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8d5cd0f3-1834-43ea-b592-33cca7b65179 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:58.609975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8d5cd0f3-1834-43ea-b592-33cca7b65179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:58.706645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:58.724698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 675/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:58.755140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd908e2-46d2-4d98-b440-c8cbe19eb38b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:58.755627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd908e2-46d2-4d98-b440-c8cbe19eb38b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:58.756037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd908e2-46d2-4d98-b440-c8cbe19eb38b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:58.757818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 691/1366] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jul 14 09:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:10:58.763822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9efc6-87af-4931-929c-b81963874394 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:58.764118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9efc6-87af-4931-929c-b81963874394 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:58.764402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9efc6-87af-4931-929c-b81963874394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:58.857014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6bf9efc6-87af-4931-929c-b81963874394 None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:10:58.858214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6bf9efc6-87af-4931-929c-b81963874394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:58.995251 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 676/1367] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jul 14 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:10:58.999259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd908e2-46d2-4d98-b440-c8cbe19eb38b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:10:59.000844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7bd908e2-46d2-4d98-b440-c8cbe19eb38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:59.170819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd908e2-46d2-4d98-b440-c8cbe19eb38b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:10:59.193602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:10:59.313322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a129830-9584-4584-85c9-e21779d17af5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:10:59.313889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a129830-9584-4584-85c9-e21779d17af5 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:10:59.314171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a129830-9584-4584-85c9-e21779d17af5 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:10:59.314444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a129830-9584-4584-85c9-e21779d17af5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:10:59.316087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6a129830-9584-4584-85c9-e21779d17af5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:10:59.425749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a129830-9584-4584-85c9-e21779d17af5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:10:59.427341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a129830-9584-4584-85c9-e21779d17af5 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:10:59.447227 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 692/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:00.283584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9ad7-ccd9-47b0-9b61-65f00678be03 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:00.284223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9ad7-ccd9-47b0-9b61-65f00678be03 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:00.284223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9ad7-ccd9-47b0-9b61-65f00678be03 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:00.285838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 677/1369] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:00.290966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56689e4d-dff2-46b4-b8f2-5a7df657ed55 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:00.291410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56689e4d-dff2-46b4-b8f2-5a7df657ed55 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:00.291524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56689e4d-dff2-46b4-b8f2-5a7df657ed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:00.325624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:00.368511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-56689e4d-dff2-46b4-b8f2-5a7df657ed55 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:00.369884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-56689e4d-dff2-46b4-b8f2-5a7df657ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:00.484708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 693/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:00.839164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4bc0-aba9-4201-b4fc-1e48f7e9378c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:00.839456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4bc0-aba9-4201-b4fc-1e48f7e9378c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:00.839732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4bc0-aba9-4201-b4fc-1e48f7e9378c None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:00.841182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 678/1371] 10.222.0.27 () {54 vars in 963 bytes} [Thu Jul 14 09:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:00.847054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e209db-7aa7-407c-a00e-d2a68e1da646 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:00.847348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e209db-7aa7-407c-a00e-d2a68e1da646 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:00.847626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e209db-7aa7-407c-a00e-d2a68e1da646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:00.929243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c4e209db-7aa7-407c-a00e-d2a68e1da646 None None] MFA Rules not processed for user `4f9b12f6e7e347e19e5183d7e45b162f`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:00.930493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c4e209db-7aa7-407c-a00e-d2a68e1da646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:00.980247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:01.014002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 694/1372] 10.222.0.27 () {58 vars in 1060 bytes} [Thu Jul 14 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:01.021423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4bc0-aba9-4201-b4fc-1e48f7e9378c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:01.022968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e72a4bc0-aba9-4201-b4fc-1e48f7e9378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:01.077269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:01.134422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4bc0-aba9-4201-b4fc-1e48f7e9378c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:01.217095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4199b13-f58a-419d-bdfc-7a1b31789722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:01.217751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199b13-f58a-419d-bdfc-7a1b31789722 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:01.218031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199b13-f58a-419d-bdfc-7a1b31789722 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:01.218304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199b13-f58a-419d-bdfc-7a1b31789722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:01.219939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c4199b13-f58a-419d-bdfc-7a1b31789722 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:01.323996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:01.338543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4199b13-f58a-419d-bdfc-7a1b31789722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:01.339909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4199b13-f58a-419d-bdfc-7a1b31789722 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:01.359306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 679/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:01.570917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644c1a-65d2-459b-b32b-c1c2c4e10cd1 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:01.571655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644c1a-65d2-459b-b32b-c1c2c4e10cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:01.571655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644c1a-65d2-459b-b32b-c1c2c4e10cd1 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:01.576869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 695/1374] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:01.578164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c2631-611b-499f-919a-6b243d9f1591 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:01.578456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c2631-611b-499f-919a-6b243d9f1591 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:01.578733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c2631-611b-499f-919a-6b243d9f1591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:01.645173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-278c2631-611b-499f-919a-6b243d9f1591 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:01.646372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-278c2631-611b-499f-919a-6b243d9f1591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:01.748711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 680/1375] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:11:01.793172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b644c1a-65d2-459b-b32b-c1c2c4e10cd1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:01.795313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2b644c1a-65d2-459b-b32b-c1c2c4e10cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:01.953586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b644c1a-65d2-459b-b32b-c1c2c4e10cd1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:02.011418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:02.077366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75252f05-48d5-4a6a-b7eb-5de09d03597f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:02.078039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75252f05-48d5-4a6a-b7eb-5de09d03597f service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:02.078322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75252f05-48d5-4a6a-b7eb-5de09d03597f service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:02.078593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75252f05-48d5-4a6a-b7eb-5de09d03597f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:02.080231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-75252f05-48d5-4a6a-b7eb-5de09d03597f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:02.185330 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75252f05-48d5-4a6a-b7eb-5de09d03597f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:02.186934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75252f05-48d5-4a6a-b7eb-5de09d03597f service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:02.208604 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 696/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:04.256978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38aa7-61cb-4695-a82a-df0b0e819b90 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:04.257533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38aa7-61cb-4695-a82a-df0b0e819b90 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:04.257533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38aa7-61cb-4695-a82a-df0b0e819b90 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:04.259065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 681/1377] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:11:04.264845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6693a-2413-49b4-bbd8-7afd3b898446 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:04.265396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6693a-2413-49b4-bbd8-7afd3b898446 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:04.265396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6693a-2413-49b4-bbd8-7afd3b898446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:04.334024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a9b6693a-2413-49b4-bbd8-7afd3b898446 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:04.335236 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a9b6693a-2413-49b4-bbd8-7afd3b898446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:04.343071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:04.459078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 697/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:11:04.503131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee38aa7-61cb-4695-a82a-df0b0e819b90 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:04.504706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cee38aa7-61cb-4695-a82a-df0b0e819b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:04.567708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:04.663113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee38aa7-61cb-4695-a82a-df0b0e819b90 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:04.807449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e832e7-d688-4bfd-9c5b-fbc0b0f26e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:04.807449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e832e7-d688-4bfd-9c5b-fbc0b0f26e12 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:04.807449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e832e7-d688-4bfd-9c5b-fbc0b0f26e12 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:04.807449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e832e7-d688-4bfd-9c5b-fbc0b0f26e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:04.809613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b5e832e7-d688-4bfd-9c5b-fbc0b0f26e12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:04.835557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:04.925935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e832e7-d688-4bfd-9c5b-fbc0b0f26e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:04.927702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e832e7-d688-4bfd-9c5b-fbc0b0f26e12 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:04.947485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 682/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:07.002709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd61797-cf3a-4a75-babe-a24289608ceb None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:07.003269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd61797-cf3a-4a75-babe-a24289608ceb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:07.003269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd61797-cf3a-4a75-babe-a24289608ceb None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:07.004783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 698/1380] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:11:07.010199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d497a-c389-463a-a0d2-27e181836664 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:07.010686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d497a-c389-463a-a0d2-27e181836664 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:07.010769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d497a-c389-463a-a0d2-27e181836664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:07.078456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-bc2d497a-c389-463a-a0d2-27e181836664 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:07.079633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bc2d497a-c389-463a-a0d2-27e181836664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:07.178579 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:07.188808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 683/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:07.230068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd61797-cf3a-4a75-babe-a24289608ceb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:07.231619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bbd61797-cf3a-4a75-babe-a24289608ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:07.393607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:07.405951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd61797-cf3a-4a75-babe-a24289608ceb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:07.529856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfd2c0-1bd9-4fac-88cf-428eaa07318f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:07.530933 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfd2c0-1bd9-4fac-88cf-428eaa07318f service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:07.531432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfd2c0-1bd9-4fac-88cf-428eaa07318f service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:07.531907 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfd2c0-1bd9-4fac-88cf-428eaa07318f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:07.533786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d7bfd2c0-1bd9-4fac-88cf-428eaa07318f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:07.634545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfd2c0-1bd9-4fac-88cf-428eaa07318f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:07.636046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfd2c0-1bd9-4fac-88cf-428eaa07318f service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:07.648719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:07.658591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 699/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:09.933546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ced24-c402-4f5b-a635-e65718a759d9 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:09.934070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ced24-c402-4f5b-a635-e65718a759d9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:09.934070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ced24-c402-4f5b-a635-e65718a759d9 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:09.935451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 684/1383] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:11:09.940910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77cceb-930f-4a45-b124-30bd6cdddf27 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:09.941366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77cceb-930f-4a45-b124-30bd6cdddf27 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:09.941460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77cceb-930f-4a45-b124-30bd6cdddf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:10.010006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2d77cceb-930f-4a45-b124-30bd6cdddf27 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:10.011205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2d77cceb-930f-4a45-b124-30bd6cdddf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:10.130823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 700/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:10.181920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ced24-c402-4f5b-a635-e65718a759d9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:10.183685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a21ced24-c402-4f5b-a635-e65718a759d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:10.350668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ced24-c402-4f5b-a635-e65718a759d9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:10.422675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:10.476060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f46dd-ff95-477d-9ed7-273fe4d81b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:10.477314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f46dd-ff95-477d-9ed7-273fe4d81b82 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:10.477903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f46dd-ff95-477d-9ed7-273fe4d81b82 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:10.478249 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f46dd-ff95-477d-9ed7-273fe4d81b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:10.480325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d38f46dd-ff95-477d-9ed7-273fe4d81b82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:10.596530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f46dd-ff95-477d-9ed7-273fe4d81b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:10.598606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f46dd-ff95-477d-9ed7-273fe4d81b82 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:10.622592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 685/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:11:13.067069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fc78-2db4-41c2-8962-19f66e5db3d1 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:13.067738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fc78-2db4-41c2-8962-19f66e5db3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:13.067738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fc78-2db4-41c2-8962-19f66e5db3d1 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:13.069108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 701/1386] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:13.075414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaee2d-bb42-4d5e-b889-7643bbc2fbcc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:13.075858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaee2d-bb42-4d5e-b889-7643bbc2fbcc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:13.076201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaee2d-bb42-4d5e-b889-7643bbc2fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:13.158877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-97aaee2d-bb42-4d5e-b889-7643bbc2fbcc None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:13.160457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-97aaee2d-bb42-4d5e-b889-7643bbc2fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:13.205248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:13.284293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 686/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:13.338708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901fc78-2db4-41c2-8962-19f66e5db3d1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:13.340353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0901fc78-2db4-41c2-8962-19f66e5db3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:13.435636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:13.507852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901fc78-2db4-41c2-8962-19f66e5db3d1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:13.632608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e7f3f-1c4d-4535-a39c-c518a5a7e2fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:13.633268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e7f3f-1c4d-4535-a39c-c518a5a7e2fc service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:13.633661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e7f3f-1c4d-4535-a39c-c518a5a7e2fc service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:13.633951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e7f3f-1c4d-4535-a39c-c518a5a7e2fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:13.635674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2f5e7f3f-1c4d-4535-a39c-c518a5a7e2fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:13.680030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:13.738147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e7f3f-1c4d-4535-a39c-c518a5a7e2fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:13.740230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e7f3f-1c4d-4535-a39c-c518a5a7e2fc service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:13.764594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 702/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:15.986592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1289a5-d91d-42d7-8d83-e1b910e328bd None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:15.987184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1289a5-d91d-42d7-8d83-e1b910e328bd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:15.987184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1289a5-d91d-42d7-8d83-e1b910e328bd None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:15.988539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 687/1389] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:15.993900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7113cc8-14c5-4874-82ae-9588094df5aa None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:15.994321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7113cc8-14c5-4874-82ae-9588094df5aa None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:15.994469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7113cc8-14c5-4874-82ae-9588094df5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:16.061922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f7113cc8-14c5-4874-82ae-9588094df5aa None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:16.063135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f7113cc8-14c5-4874-82ae-9588094df5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:16.171129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 703/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:16.215552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1289a5-d91d-42d7-8d83-e1b910e328bd None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:16.217137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dc1289a5-d91d-42d7-8d83-e1b910e328bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:16.373525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1289a5-d91d-42d7-8d83-e1b910e328bd None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:16.391771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:16.492686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2a4fa-d7fc-4e97-8ff9-66f808f15548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:16.493502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2a4fa-d7fc-4e97-8ff9-66f808f15548 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:16.493926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2a4fa-d7fc-4e97-8ff9-66f808f15548 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:16.494203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2a4fa-d7fc-4e97-8ff9-66f808f15548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:16.495863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-63f2a4fa-d7fc-4e97-8ff9-66f808f15548 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:16.588562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2a4fa-d7fc-4e97-8ff9-66f808f15548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:16.590178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2a4fa-d7fc-4e97-8ff9-66f808f15548 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:16.608700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 688/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:16.703682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860cc54-8b40-4d43-a039-c55a10f036a7 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:16.703925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860cc54-8b40-4d43-a039-c55a10f036a7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:16.704236 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860cc54-8b40-4d43-a039-c55a10f036a7 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:16.705671 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 704/1392] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:16.712146 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3972383-d695-4001-a5e1-525e7b2f9fa0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:16.712804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3972383-d695-4001-a5e1-525e7b2f9fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:16.712804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3972383-d695-4001-a5e1-525e7b2f9fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:16.740015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:16.787517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c3972383-d695-4001-a5e1-525e7b2f9fa0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:16.788777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c3972383-d695-4001-a5e1-525e7b2f9fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:16.893528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 689/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:16.949972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e311c09-5e87-4d21-bad3-d1e7bdd9b8a5 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:16.950255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e311c09-5e87-4d21-bad3-d1e7bdd9b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:16.950526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e311c09-5e87-4d21-bad3-d1e7bdd9b8a5 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:16.951900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 705/1394] 10.222.0.27 () {54 vars in 962 bytes} [Thu Jul 14 09:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:16.957234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbb21d-d667-4813-a372-f64a3c63e2f3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:16.957598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbb21d-d667-4813-a372-f64a3c63e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:16.957947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbb21d-d667-4813-a372-f64a3c63e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:17.049761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-20fbb21d-d667-4813-a372-f64a3c63e2f3 None None] MFA Rules not processed for user `ebf4ab9d717e4c838d68590336074f09`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:17.050955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-20fbb21d-d667-4813-a372-f64a3c63e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:17.095108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:17.133125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 690/1395] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Jul 14 09:11:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:11:17.141787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e311c09-5e87-4d21-bad3-d1e7bdd9b8a5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:17.143319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1e311c09-5e87-4d21-bad3-d1e7bdd9b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:17.158770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:17.259603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e311c09-5e87-4d21-bad3-d1e7bdd9b8a5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:17.338644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6010fd-5e9c-4db8-a0e2-efa06143923e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf4ab9d717e4c838d68590336074f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:17.339297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6010fd-5e9c-4db8-a0e2-efa06143923e service glance] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:17.339575 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6010fd-5e9c-4db8-a0e2-efa06143923e service glance] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:17.339846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6010fd-5e9c-4db8-a0e2-efa06143923e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:17.341521 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0c6010fd-5e9c-4db8-a0e2-efa06143923e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:17.425248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:17.468377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6010fd-5e9c-4db8-a0e2-efa06143923e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:17.469921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6010fd-5e9c-4db8-a0e2-efa06143923e service glance] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:17.488614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 706/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:18.208055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4942451-172e-42a2-92a2-465c87510574 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:18.208609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4942451-172e-42a2-92a2-465c87510574 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:18.208609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4942451-172e-42a2-92a2-465c87510574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:18.282284 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b4942451-172e-42a2-92a2-465c87510574 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:18.283514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b4942451-172e-42a2-92a2-465c87510574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:18.378701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 691/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:18.424421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ea25-32c9-4ae7-9bd2-40e74a417441 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:18.424928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ea25-32c9-4ae7-9bd2-40e74a417441 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:18.425150 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ea25-32c9-4ae7-9bd2-40e74a417441 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:18.426617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 707/1398] 10.222.0.27 () {54 vars in 942 bytes} [Thu Jul 14 09:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:18.433002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7c30c-0ff6-4fcc-929f-e614f0fde9cc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:18.433324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7c30c-0ff6-4fcc-929f-e614f0fde9cc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:18.433611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7c30c-0ff6-4fcc-929f-e614f0fde9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:18.500737 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:18.509685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-58a7c30c-0ff6-4fcc-929f-e614f0fde9cc None None] MFA Rules not processed for user `2dab40ef1f8d4f5abf10b92e99e04122`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:18.510872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-58a7c30c-0ff6-4fcc-929f-e614f0fde9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:18.631880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 692/1399] 10.222.0.27 () {58 vars in 1039 bytes} [Thu Jul 14 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:18.642533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ea25-32c9-4ae7-9bd2-40e74a417441 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:18.644078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4e01ea25-32c9-4ae7-9bd2-40e74a417441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:18.682751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818b7b8-d16e-4c52-90da-a65c2d0f1a25 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:18.683012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818b7b8-d16e-4c52-90da-a65c2d0f1a25 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:18.683315 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818b7b8-d16e-4c52-90da-a65c2d0f1a25 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:18.684698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 693/1400] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:11:18.689612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce510a-6e91-4b83-bdbc-032399207bd8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:18.689899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce510a-6e91-4b83-bdbc-032399207bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:18.690174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce510a-6e91-4b83-bdbc-032399207bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:18.758421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b6ce510a-6e91-4b83-bdbc-032399207bd8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:18.759789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b6ce510a-6e91-4b83-bdbc-032399207bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:18.791526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ea25-32c9-4ae7-9bd2-40e74a417441 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:18.823865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:18.830837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:18.862696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 694/1401] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:11:18.901951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e018e3-c974-490c-93d8-8a5d2673af14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:18.902610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e018e3-c974-490c-93d8-8a5d2673af14 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:18.902891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e018e3-c974-490c-93d8-8a5d2673af14 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:18.903165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e018e3-c974-490c-93d8-8a5d2673af14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:18.904891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c4e018e3-c974-490c-93d8-8a5d2673af14 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:18.906999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce510a-6e91-4b83-bdbc-032399207bd8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:18.908730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b6ce510a-6e91-4b83-bdbc-032399207bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:18.990612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e018e3-c974-490c-93d8-8a5d2673af14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:18.992218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e018e3-c974-490c-93d8-8a5d2673af14 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:19.000448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 708/1402] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:11:19.025925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce510a-6e91-4b83-bdbc-032399207bd8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:19.109093 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:19.161600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd781d-a2fc-453b-a30c-1ebe9cb41b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:19.162480 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd781d-a2fc-453b-a30c-1ebe9cb41b89 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:19.162801 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd781d-a2fc-453b-a30c-1ebe9cb41b89 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:19.163078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd781d-a2fc-453b-a30c-1ebe9cb41b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:19.166169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8edd781d-a2fc-453b-a30c-1ebe9cb41b89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:19.271709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd781d-a2fc-453b-a30c-1ebe9cb41b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:19.273385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd781d-a2fc-453b-a30c-1ebe9cb41b89 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:19.292573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 695/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:11:21.421767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f199f-4baa-4653-80d8-b1391ffd9e22 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:21.422701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f199f-4baa-4653-80d8-b1391ffd9e22 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:21.422983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f199f-4baa-4653-80d8-b1391ffd9e22 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:21.424533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 709/1404] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:21.429720 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7edf6a-f434-488a-90c4-460626c9a78a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:21.430168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7edf6a-f434-488a-90c4-460626c9a78a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:21.430276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7edf6a-f434-488a-90c4-460626c9a78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:21.507308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3c7edf6a-f434-488a-90c4-460626c9a78a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:21.508852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3c7edf6a-f434-488a-90c4-460626c9a78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:21.550818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:21.614687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 696/1405] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:21.658260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f199f-4baa-4653-80d8-b1391ffd9e22 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:21.659811 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bf8f199f-4baa-4653-80d8-b1391ffd9e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:21.739676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:21.821947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f199f-4baa-4653-80d8-b1391ffd9e22 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:21.951221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8ab6c-0cac-4186-aaed-52ee409634d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:21.952003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8ab6c-0cac-4186-aaed-52ee409634d2 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:21.952294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8ab6c-0cac-4186-aaed-52ee409634d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:21.952600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8ab6c-0cac-4186-aaed-52ee409634d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:21.954343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e5f8ab6c-0cac-4186-aaed-52ee409634d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:21.990935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:22.060708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8ab6c-0cac-4186-aaed-52ee409634d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:22.062615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8ab6c-0cac-4186-aaed-52ee409634d2 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:22.083843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 710/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:24.150190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a47b55-9078-41bb-bbb6-58633af05a0f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:24.150790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a47b55-9078-41bb-bbb6-58633af05a0f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:24.150790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a47b55-9078-41bb-bbb6-58633af05a0f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:24.156191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 697/1407] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:11:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:24.159085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3434e-409e-41e2-9654-5ff5eb092838 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:24.160080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3434e-409e-41e2-9654-5ff5eb092838 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:24.160572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3434e-409e-41e2-9654-5ff5eb092838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:24.242590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cce3434e-409e-41e2-9654-5ff5eb092838 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:24.245642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cce3434e-409e-41e2-9654-5ff5eb092838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:24.352175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 711/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:24.399412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a47b55-9078-41bb-bbb6-58633af05a0f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:24.401386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-47a47b55-9078-41bb-bbb6-58633af05a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:24.573312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a47b55-9078-41bb-bbb6-58633af05a0f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:24.599208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:24.705447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144dfd5-3f0c-4986-80f1-3f3be8aa33d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:24.706960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144dfd5-3f0c-4986-80f1-3f3be8aa33d6 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:24.707258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144dfd5-3f0c-4986-80f1-3f3be8aa33d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:24.707539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144dfd5-3f0c-4986-80f1-3f3be8aa33d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:24.709258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6144dfd5-3f0c-4986-80f1-3f3be8aa33d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:24.809301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144dfd5-3f0c-4986-80f1-3f3be8aa33d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:24.810904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144dfd5-3f0c-4986-80f1-3f3be8aa33d6 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:24.840144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 698/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:34.350202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:34.827433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=88 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:41.271559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491dc4-5a78-4514-b285-c9dcbce21f56 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:41.272062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491dc4-5a78-4514-b285-c9dcbce21f56 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:41.272171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491dc4-5a78-4514-b285-c9dcbce21f56 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:41.274300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 712/1410] 10.222.0.27 () {54 vars in 918 bytes} [Thu Jul 14 09:11:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:41.279930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4010fbe-8da8-4f62-8e9f-9e0c70306b6e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:41.280362 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4010fbe-8da8-4f62-8e9f-9e0c70306b6e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:41.280457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4010fbe-8da8-4f62-8e9f-9e0c70306b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:41.372796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a4010fbe-8da8-4f62-8e9f-9e0c70306b6e None None] MFA Rules not processed for user `58986e97f4d849aba35149d3666db015`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:41.374250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a4010fbe-8da8-4f62-8e9f-9e0c70306b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:41.494262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 699/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jul 14 09:11:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:41.509416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8c73-d23e-42ec-918f-0a5194942dc9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:41.509708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8c73-d23e-42ec-918f-0a5194942dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:41.510000 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8c73-d23e-42ec-918f-0a5194942dc9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:41.511540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 713/1412] 10.222.0.27 () {54 vars in 918 bytes} [Thu Jul 14 09:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:41.516557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eef4d-8903-4c11-815e-cd8d56f93372 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:41.516888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eef4d-8903-4c11-815e-cd8d56f93372 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:41.517484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eef4d-8903-4c11-815e-cd8d56f93372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:41.591439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:41.595170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a52eef4d-8903-4c11-815e-cd8d56f93372 None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:41.597095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a52eef4d-8903-4c11-815e-cd8d56f93372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:41.721472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 700/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jul 14 09:11:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:44.213452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b99d6c-29bf-49eb-bc9d-87d54119756a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:44.214409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b99d6c-29bf-49eb-bc9d-87d54119756a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:44.214521 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b99d6c-29bf-49eb-bc9d-87d54119756a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:44.216013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:11:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:44.223965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196199-908b-4079-a15f-f2a16d40499a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:44.224432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196199-908b-4079-a15f-f2a16d40499a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:44.224534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196199-908b-4079-a15f-f2a16d40499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:44.302366 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-72196199-908b-4079-a15f-f2a16d40499a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:44.303577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-72196199-908b-4079-a15f-f2a16d40499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:44.363509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:44.412200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:44.458068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b99d6c-29bf-49eb-bc9d-87d54119756a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:44.459599 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e9b99d6c-29bf-49eb-bc9d-87d54119756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:44.631970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b99d6c-29bf-49eb-bc9d-87d54119756a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:44.713467 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:44.754448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d9ff0-a098-42e1-8c77-b19724210acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:44.755089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d9ff0-a098-42e1-8c77-b19724210acf service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:44.755371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d9ff0-a098-42e1-8c77-b19724210acf service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:44.755645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d9ff0-a098-42e1-8c77-b19724210acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:44.757308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fd2d9ff0-a098-42e1-8c77-b19724210acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:44.864156 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d9ff0-a098-42e1-8c77-b19724210acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:44.865785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d9ff0-a098-42e1-8c77-b19724210acf service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:44.885174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 715/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:45.794575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd70f3-715e-417d-b49d-ee3811cf94a3 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:45.795443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd70f3-715e-417d-b49d-ee3811cf94a3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:45.795443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd70f3-715e-417d-b49d-ee3811cf94a3 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:45.797648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:11:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:45.803593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de40e-e3b3-40bb-b638-d550f78b9c7a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:45.804389 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de40e-e3b3-40bb-b638-d550f78b9c7a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:45.804554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de40e-e3b3-40bb-b638-d550f78b9c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:45.890709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-558de40e-e3b3-40bb-b638-d550f78b9c7a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:45.891911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-558de40e-e3b3-40bb-b638-d550f78b9c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:45.920121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:45.999584 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:46.155713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd70f3-715e-417d-b49d-ee3811cf94a3 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:46.158102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-facd70f3-715e-417d-b49d-ee3811cf94a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:46.320172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd70f3-715e-417d-b49d-ee3811cf94a3 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:46.367160 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:46.456114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f205b-acf2-41c5-98e9-950318556f50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:46.456799 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f205b-acf2-41c5-98e9-950318556f50 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:46.457076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f205b-acf2-41c5-98e9-950318556f50 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:46.457347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f205b-acf2-41c5-98e9-950318556f50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:46.459021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-848f205b-acf2-41c5-98e9-950318556f50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:46.556061 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f205b-acf2-41c5-98e9-950318556f50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:46.557673 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f205b-acf2-41c5-98e9-950318556f50 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:46.575962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 703/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:47.489462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafdd71-87cd-425c-8497-1e419291edb1 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:47.490358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafdd71-87cd-425c-8497-1e419291edb1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:47.490358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafdd71-87cd-425c-8497-1e419291edb1 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:47.492572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:11:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:47.498873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7d59-9f85-44cc-a44c-71f8b74a7142 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:47.499328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7d59-9f85-44cc-a44c-71f8b74a7142 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:47.499433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7d59-9f85-44cc-a44c-71f8b74a7142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:47.562864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:47.587632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b03d7d59-9f85-44cc-a44c-71f8b74a7142 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:47.588882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b03d7d59-9f85-44cc-a44c-71f8b74a7142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:47.707613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:47.865847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafdd71-87cd-425c-8497-1e419291edb1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:47.868304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9fafdd71-87cd-425c-8497-1e419291edb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:48.035936 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafdd71-87cd-425c-8497-1e419291edb1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:48.048695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:48.164466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598e0c9-ce15-4ed7-b1c9-59453d14eeff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:48.165052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598e0c9-ce15-4ed7-b1c9-59453d14eeff service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:48.165337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598e0c9-ce15-4ed7-b1c9-59453d14eeff service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:48.165611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598e0c9-ce15-4ed7-b1c9-59453d14eeff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:48.167432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5598e0c9-ce15-4ed7-b1c9-59453d14eeff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:48.266711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598e0c9-ce15-4ed7-b1c9-59453d14eeff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:48.268632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598e0c9-ce15-4ed7-b1c9-59453d14eeff service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:48.292679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 718/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:49.163972 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95083330-c5c5-4b7e-aeaa-cefdf4abb16e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:49.165118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95083330-c5c5-4b7e-aeaa-cefdf4abb16e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:49.165118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95083330-c5c5-4b7e-aeaa-cefdf4abb16e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:49.167141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:11:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:49.173270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0151d-122b-42cd-9c8c-890add5adfc0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:49.173734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0151d-122b-42cd-9c8c-890add5adfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:49.173855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0151d-122b-42cd-9c8c-890add5adfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:49.193952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:49.256137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0ef0151d-122b-42cd-9c8c-890add5adfc0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:49.257397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0ef0151d-122b-42cd-9c8c-890add5adfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:49.362864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:49.516642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95083330-c5c5-4b7e-aeaa-cefdf4abb16e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:49.519549 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-95083330-c5c5-4b7e-aeaa-cefdf4abb16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:49.642431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:49.679264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95083330-c5c5-4b7e-aeaa-cefdf4abb16e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:49.801492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e095eeb-36be-4b78-9f00-f8a46fc9f6bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:49.802060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095eeb-36be-4b78-9f00-f8a46fc9f6bb service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:49.802340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095eeb-36be-4b78-9f00-f8a46fc9f6bb service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:49.802607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095eeb-36be-4b78-9f00-f8a46fc9f6bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:49.804257 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4e095eeb-36be-4b78-9f00-f8a46fc9f6bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:49.892106 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:49.907373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e095eeb-36be-4b78-9f00-f8a46fc9f6bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:49.909030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e095eeb-36be-4b78-9f00-f8a46fc9f6bb service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:49.928504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 706/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:50.789731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2f50-7655-46d1-a16c-e3980262bbdf None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:50.790335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2f50-7655-46d1-a16c-e3980262bbdf None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:50.790335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2f50-7655-46d1-a16c-e3980262bbdf None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:50.791764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:50.797904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c665f6-dcd7-4878-a8aa-d27b57688ed3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:50.798692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c665f6-dcd7-4878-a8aa-d27b57688ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:50.798847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c665f6-dcd7-4878-a8aa-d27b57688ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:50.892988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-98c665f6-dcd7-4878-a8aa-d27b57688ed3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:50.894541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-98c665f6-dcd7-4878-a8aa-d27b57688ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:51.000423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:51.153802 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf2f50-7655-46d1-a16c-e3980262bbdf None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:51.156080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f0cf2f50-7655-46d1-a16c-e3980262bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:51.267237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:51.335262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf2f50-7655-46d1-a16c-e3980262bbdf None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:51.460920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d5b54-f6fd-4054-ad0b-a59f1be60a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:51.461575 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d5b54-f6fd-4054-ad0b-a59f1be60a29 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:51.461858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d5b54-f6fd-4054-ad0b-a59f1be60a29 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:51.462135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d5b54-f6fd-4054-ad0b-a59f1be60a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:51.463801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5a3d5b54-f6fd-4054-ad0b-a59f1be60a29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:51.514809 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:51.565580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d5b54-f6fd-4054-ad0b-a59f1be60a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:51.567191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d5b54-f6fd-4054-ad0b-a59f1be60a29 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:51.588684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 721/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:52.391653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b628b9b-81f6-453a-a54e-0aa76930ac10 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:52.392194 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b628b9b-81f6-453a-a54e-0aa76930ac10 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:52.392194 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b628b9b-81f6-453a-a54e-0aa76930ac10 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:52.394723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:11:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:52.403069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c143c-ba67-4048-937a-367179341331 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:52.403527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c143c-ba67-4048-937a-367179341331 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:52.403630 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c143c-ba67-4048-937a-367179341331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:52.482433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-be7c143c-ba67-4048-937a-367179341331 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:52.483920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-be7c143c-ba67-4048-937a-367179341331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:52.605838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:52.753934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b628b9b-81f6-453a-a54e-0aa76930ac10 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:52.756144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1b628b9b-81f6-453a-a54e-0aa76930ac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:52.810720 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:52.919081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b628b9b-81f6-453a-a54e-0aa76930ac10 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:53.050538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4717b-eeb3-4b66-a025-92ed65ee4c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:53.051102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4717b-eeb3-4b66-a025-92ed65ee4c46 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:53.051386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4717b-eeb3-4b66-a025-92ed65ee4c46 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:53.051658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4717b-eeb3-4b66-a025-92ed65ee4c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:53.053328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9dd4717b-eeb3-4b66-a025-92ed65ee4c46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:53.063332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:53.153441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4717b-eeb3-4b66-a025-92ed65ee4c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:53.155044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4717b-eeb3-4b66-a025-92ed65ee4c46 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:53.173962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 709/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:53.973084 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465b2b9-8dd7-4d11-a3dc-5eb066837f10 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:53.974004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465b2b9-8dd7-4d11-a3dc-5eb066837f10 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:53.974004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465b2b9-8dd7-4d11-a3dc-5eb066837f10 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:53.976200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:11:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:53.984825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a267-5f5c-43a2-adf5-3e827fd34047 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:53.985265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a267-5f5c-43a2-adf5-3e827fd34047 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:53.985409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a267-5f5c-43a2-adf5-3e827fd34047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:54.065670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1157a267-5f5c-43a2-adf5-3e827fd34047 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:54.066868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1157a267-5f5c-43a2-adf5-3e827fd34047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:54.148706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:54.182855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:54.336176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465b2b9-8dd7-4d11-a3dc-5eb066837f10 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:54.338536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2465b2b9-8dd7-4d11-a3dc-5eb066837f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:54.365955 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:54.510759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465b2b9-8dd7-4d11-a3dc-5eb066837f10 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:54.608258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:54.638338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd5fc4-471c-4943-a9d2-e83921e30b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:54.638993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd5fc4-471c-4943-a9d2-e83921e30b91 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:54.639272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd5fc4-471c-4943-a9d2-e83921e30b91 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:54.639530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd5fc4-471c-4943-a9d2-e83921e30b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:54.641207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b9cd5fc4-471c-4943-a9d2-e83921e30b91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:54.731312 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd5fc4-471c-4943-a9d2-e83921e30b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:54.733011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd5fc4-471c-4943-a9d2-e83921e30b91 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:54.751474 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 724/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:55.570290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c1195-257e-4fb7-b071-42614f045e01 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:55.571148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c1195-257e-4fb7-b071-42614f045e01 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:55.571148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c1195-257e-4fb7-b071-42614f045e01 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:55.573358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:11:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:55.579440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c521a-6a42-4776-b124-c5e0b575a305 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:55.580173 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c521a-6a42-4776-b124-c5e0b575a305 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:55.580336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c521a-6a42-4776-b124-c5e0b575a305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:55.665201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-410c521a-6a42-4776-b124-c5e0b575a305 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:55.666418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-410c521a-6a42-4776-b124-c5e0b575a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:55.711004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:55.788110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:55.943963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c1195-257e-4fb7-b071-42614f045e01 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:55.946371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-be7c1195-257e-4fb7-b071-42614f045e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:56.108355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c1195-257e-4fb7-b071-42614f045e01 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:56.164740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:56.239437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ca3d9-c9e7-4691-bc9a-f47543de7f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:56.240098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca3d9-c9e7-4691-bc9a-f47543de7f0f service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:56.240385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca3d9-c9e7-4691-bc9a-f47543de7f0f service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:56.240695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca3d9-c9e7-4691-bc9a-f47543de7f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:56.242373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2c2ca3d9-c9e7-4691-bc9a-f47543de7f0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:56.335598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ca3d9-c9e7-4691-bc9a-f47543de7f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:56.337246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ca3d9-c9e7-4691-bc9a-f47543de7f0f service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:56.359129 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 712/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:57.156547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7043ea-6f22-4e44-be9c-ef1ae70c32e8 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:57.157146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7043ea-6f22-4e44-be9c-ef1ae70c32e8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:57.157146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7043ea-6f22-4e44-be9c-ef1ae70c32e8 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:57.159191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:11:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:57.167006 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b851-fdfa-4cfd-b317-bc00fae7d2b8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:57.167406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b851-fdfa-4cfd-b317-bc00fae7d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:57.167624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b851-fdfa-4cfd-b317-bc00fae7d2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:57.254449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-17c9b851-fdfa-4cfd-b317-bc00fae7d2b8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:57.255661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-17c9b851-fdfa-4cfd-b317-bc00fae7d2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:57.257775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:57.361136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:11:57.513604 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7043ea-6f22-4e44-be9c-ef1ae70c32e8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:11:57.515646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0e7043ea-6f22-4e44-be9c-ef1ae70c32e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:57.689408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7043ea-6f22-4e44-be9c-ef1ae70c32e8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:11:57.717827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:57.809053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57602a-21b5-4a77-a6cf-606ae1a7c879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:11:57.809616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57602a-21b5-4a77-a6cf-606ae1a7c879 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:57.809897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57602a-21b5-4a77-a6cf-606ae1a7c879 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:57.810171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57602a-21b5-4a77-a6cf-606ae1a7c879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:57.811857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0b57602a-21b5-4a77-a6cf-606ae1a7c879 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:11:57.908196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57602a-21b5-4a77-a6cf-606ae1a7c879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:11:57.909807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57602a-21b5-4a77-a6cf-606ae1a7c879 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:11:57.928065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 727/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:11:59.854476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d36d61-f00a-42b0-a996-b57a5f75e34c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:59.855071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d36d61-f00a-42b0-a996-b57a5f75e34c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:59.855071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d36d61-f00a-42b0-a996-b57a5f75e34c None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:59.856640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:11:59.863138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c29ee9-2424-4f0d-90df-437797da405b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:11:59.863906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c29ee9-2424-4f0d-90df-437797da405b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:11:59.864082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c29ee9-2424-4f0d-90df-437797da405b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:11:59.908570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:11:59.936124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-72c29ee9-2424-4f0d-90df-437797da405b None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:11:59.937388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-72c29ee9-2424-4f0d-90df-437797da405b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:00.042255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:00.080280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d36d61-f00a-42b0-a996-b57a5f75e34c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:00.081879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-50d36d61-f00a-42b0-a996-b57a5f75e34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:00.211508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d36d61-f00a-42b0-a996-b57a5f75e34c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:00.246198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:00.291403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e24d7-bd3c-47b4-b06b-a3971c9218a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:00.292059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e24d7-bd3c-47b4-b06b-a3971c9218a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:00.292341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e24d7-bd3c-47b4-b06b-a3971c9218a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:00.292620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e24d7-bd3c-47b4-b06b-a3971c9218a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:00.294888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-954e24d7-bd3c-47b4-b06b-a3971c9218a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:00.414144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e24d7-bd3c-47b4-b06b-a3971c9218a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:00.415577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e24d7-bd3c-47b4-b06b-a3971c9218a3 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:00.433989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 715/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:02.730262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd02a-8890-44e2-9361-d553b9e0a4df None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:02.730807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd02a-8890-44e2-9361-d553b9e0a4df None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:02.730807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd02a-8890-44e2-9361-d553b9e0a4df None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:02.732399 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:02.739150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317990c-2d5f-46d0-bb02-e33772e70a4f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:02.739894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317990c-2d5f-46d0-bb02-e33772e70a4f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:02.740077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317990c-2d5f-46d0-bb02-e33772e70a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:02.818270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1317990c-2d5f-46d0-bb02-e33772e70a4f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:02.819480 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1317990c-2d5f-46d0-bb02-e33772e70a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:02.834703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:02.928528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:02.966288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffd02a-8890-44e2-9361-d553b9e0a4df None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:02.967820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a0ffd02a-8890-44e2-9361-d553b9e0a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:03.080505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffd02a-8890-44e2-9361-d553b9e0a4df None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:03.093901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:03.161460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edb7a8-90ce-4e2b-a7bc-fa687521be76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:03.162086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edb7a8-90ce-4e2b-a7bc-fa687521be76 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:03.162362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edb7a8-90ce-4e2b-a7bc-fa687521be76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:03.162632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edb7a8-90ce-4e2b-a7bc-fa687521be76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:03.164321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a9edb7a8-90ce-4e2b-a7bc-fa687521be76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:03.280060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edb7a8-90ce-4e2b-a7bc-fa687521be76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:03.281537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edb7a8-90ce-4e2b-a7bc-fa687521be76 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:03.299769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 730/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:12:05.692501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ab5eb-fad7-475b-8249-9e2434a3fe6e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:05.693105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ab5eb-fad7-475b-8249-9e2434a3fe6e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:05.693105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ab5eb-fad7-475b-8249-9e2434a3fe6e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:05.695024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:12:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:05.703023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254ceb0-3c20-4fe9-b34c-b22fa85469a2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:05.703434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254ceb0-3c20-4fe9-b34c-b22fa85469a2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:05.703570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254ceb0-3c20-4fe9-b34c-b22fa85469a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:05.753323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:05.773461 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7254ceb0-3c20-4fe9-b34c-b22fa85469a2 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:05.774661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7254ceb0-3c20-4fe9-b34c-b22fa85469a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:05.873831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:05.916445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ab5eb-fad7-475b-8249-9e2434a3fe6e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:05.918042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-767ab5eb-fad7-475b-8249-9e2434a3fe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:06.033951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ab5eb-fad7-475b-8249-9e2434a3fe6e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:06.078023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:06.116849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50121fe4-3967-489e-9d98-9aeb435c09f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:06.117506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50121fe4-3967-489e-9d98-9aeb435c09f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:06.117787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50121fe4-3967-489e-9d98-9aeb435c09f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:06.118064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50121fe4-3967-489e-9d98-9aeb435c09f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:06.119704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-50121fe4-3967-489e-9d98-9aeb435c09f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:06.233209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50121fe4-3967-489e-9d98-9aeb435c09f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:06.234623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50121fe4-3967-489e-9d98-9aeb435c09f5 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:06.254247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 718/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:08.454615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b231f89-c320-4044-b88b-a8637ad5568b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:08.455512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b231f89-c320-4044-b88b-a8637ad5568b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:08.455512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b231f89-c320-4044-b88b-a8637ad5568b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:08.457765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:12:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:08.464278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b031-3a6f-40dc-bf5c-d639904121fa None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:08.464769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b031-3a6f-40dc-bf5c-d639904121fa None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:08.464891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b031-3a6f-40dc-bf5c-d639904121fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:08.540044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3812b031-3a6f-40dc-bf5c-d639904121fa None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:08.541372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3812b031-3a6f-40dc-bf5c-d639904121fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:08.564268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:08.642414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:08.692282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b231f89-c320-4044-b88b-a8637ad5568b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:08.694904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5b231f89-c320-4044-b88b-a8637ad5568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:08.806568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b231f89-c320-4044-b88b-a8637ad5568b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:08.827904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:08.887131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4402a0f-72cc-4c5b-b58e-60dff1d3cd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:08.887780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4402a0f-72cc-4c5b-b58e-60dff1d3cd05 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:08.888199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4402a0f-72cc-4c5b-b58e-60dff1d3cd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:08.888473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4402a0f-72cc-4c5b-b58e-60dff1d3cd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:08.890236 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c4402a0f-72cc-4c5b-b58e-60dff1d3cd05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:09.017576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4402a0f-72cc-4c5b-b58e-60dff1d3cd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:09.019020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4402a0f-72cc-4c5b-b58e-60dff1d3cd05 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:09.038424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 733/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:11.162263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299473a1-fd71-4e38-9314-8a9a5133537a None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:11.162863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299473a1-fd71-4e38-9314-8a9a5133537a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:11.162863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299473a1-fd71-4e38-9314-8a9a5133537a None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:11.164218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:11.171047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5006a1-0c42-483a-a1d6-aba75d9d3fba None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:11.171757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5006a1-0c42-483a-a1d6-aba75d9d3fba None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:11.171940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5006a1-0c42-483a-a1d6-aba75d9d3fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:11.243391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:11.247982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ee5006a1-0c42-483a-a1d6-aba75d9d3fba None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:11.250065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ee5006a1-0c42-483a-a1d6-aba75d9d3fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:11.360168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:11.398875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299473a1-fd71-4e38-9314-8a9a5133537a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:11.401252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-299473a1-fd71-4e38-9314-8a9a5133537a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:11.519394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299473a1-fd71-4e38-9314-8a9a5133537a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:11.571228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:11.596630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61022492-de8b-4a3e-b434-cd92bcb3f9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:11.597305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61022492-de8b-4a3e-b434-cd92bcb3f9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:11.597583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61022492-de8b-4a3e-b434-cd92bcb3f9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:11.597856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61022492-de8b-4a3e-b434-cd92bcb3f9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:11.599481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-61022492-de8b-4a3e-b434-cd92bcb3f9d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:11.722091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61022492-de8b-4a3e-b434-cd92bcb3f9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:11.723516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61022492-de8b-4a3e-b434-cd92bcb3f9d2 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:11.742290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 721/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:13.823521 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873256-c2d0-43cb-9d63-e3a2ed18eb0b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:13.824074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873256-c2d0-43cb-9d63-e3a2ed18eb0b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:13.824074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873256-c2d0-43cb-9d63-e3a2ed18eb0b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:13.825522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:13.832550 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f078-300f-4dd6-9e24-f8544fe633f9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:13.833373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f078-300f-4dd6-9e24-f8544fe633f9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:13.833524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f078-300f-4dd6-9e24-f8544fe633f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:13.907534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9be2f078-300f-4dd6-9e24-f8544fe633f9 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:13.908766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9be2f078-300f-4dd6-9e24-f8544fe633f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:13.938817 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:14.021217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:14.070983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873256-c2d0-43cb-9d63-e3a2ed18eb0b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:14.073409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-76873256-c2d0-43cb-9d63-e3a2ed18eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:14.198246 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873256-c2d0-43cb-9d63-e3a2ed18eb0b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:14.226434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:14.273373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa49300-a93e-4c4c-809f-c0f4f9769c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:14.274025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49300-a93e-4c4c-809f-c0f4f9769c79 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:14.274308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49300-a93e-4c4c-809f-c0f4f9769c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:14.274606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49300-a93e-4c4c-809f-c0f4f9769c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:14.276289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4aa49300-a93e-4c4c-809f-c0f4f9769c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:14.390169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa49300-a93e-4c4c-809f-c0f4f9769c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:14.391621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa49300-a93e-4c4c-809f-c0f4f9769c79 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:14.413079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 736/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:16.470338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5d59c-94f1-4998-9309-9d8579d67e02 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:16.470902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5d59c-94f1-4998-9309-9d8579d67e02 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:16.470902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5d59c-94f1-4998-9309-9d8579d67e02 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:16.473056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:12:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:12:16.478832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bb2fe-bc08-4b93-b46f-2933514cee1e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:16.479275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bb2fe-bc08-4b93-b46f-2933514cee1e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:16.479394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bb2fe-bc08-4b93-b46f-2933514cee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:16.548059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b39bb2fe-bc08-4b93-b46f-2933514cee1e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:16.549275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b39bb2fe-bc08-4b93-b46f-2933514cee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:16.558337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:16.662837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:12:16.699972 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5d59c-94f1-4998-9309-9d8579d67e02 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:16.701834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-91d5d59c-94f1-4998-9309-9d8579d67e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:16.834496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5d59c-94f1-4998-9309-9d8579d67e02 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:16.906715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:16.927204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9441934-c5c6-4bd1-ab51-b6978aa2753c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:16.927780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441934-c5c6-4bd1-ab51-b6978aa2753c service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:16.928057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441934-c5c6-4bd1-ab51-b6978aa2753c service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:16.928330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441934-c5c6-4bd1-ab51-b6978aa2753c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:16.929993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a9441934-c5c6-4bd1-ab51-b6978aa2753c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:17.046756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9441934-c5c6-4bd1-ab51-b6978aa2753c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:17.048197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9441934-c5c6-4bd1-ab51-b6978aa2753c service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:17.066921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 724/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:19.135356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43e3eb-3850-40f9-83d1-591ce6c7f184 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:19.136121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43e3eb-3850-40f9-83d1-591ce6c7f184 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:19.136121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43e3eb-3850-40f9-83d1-591ce6c7f184 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:19.139242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:12:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:19.145007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33ed5e-126e-4b30-b1c1-d1429c6ed40e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:19.145469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33ed5e-126e-4b30-b1c1-d1429c6ed40e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:19.145576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33ed5e-126e-4b30-b1c1-d1429c6ed40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:19.216050 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-de33ed5e-126e-4b30-b1c1-d1429c6ed40e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:19.217339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-de33ed5e-126e-4b30-b1c1-d1429c6ed40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:19.257913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:19.322590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:19.363734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43e3eb-3850-40f9-83d1-591ce6c7f184 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:19.366006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9d43e3eb-3850-40f9-83d1-591ce6c7f184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:19.478861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43e3eb-3850-40f9-83d1-591ce6c7f184 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:19.518991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:19.555593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f580e-f38c-4dfa-9638-3193935ebe6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:19.556261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f580e-f38c-4dfa-9638-3193935ebe6c service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:19.556542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f580e-f38c-4dfa-9638-3193935ebe6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:19.556853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f580e-f38c-4dfa-9638-3193935ebe6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:19.558557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-185f580e-f38c-4dfa-9638-3193935ebe6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:19.676485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f580e-f38c-4dfa-9638-3193935ebe6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:19.677951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f580e-f38c-4dfa-9638-3193935ebe6c service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:19.697055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 739/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:21.725109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52f5b1-cd4a-4088-9da2-73bd11cd8663 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:21.725661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52f5b1-cd4a-4088-9da2-73bd11cd8663 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:21.725661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52f5b1-cd4a-4088-9da2-73bd11cd8663 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:21.727057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:21.734272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787928b-8201-419d-8d5f-0cf6f816c913 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:21.734897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787928b-8201-419d-8d5f-0cf6f816c913 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:21.734990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787928b-8201-419d-8d5f-0cf6f816c913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:21.810897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0787928b-8201-419d-8d5f-0cf6f816c913 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:21.812723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0787928b-8201-419d-8d5f-0cf6f816c913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:21.831802 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:21.915817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:21.954973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52f5b1-cd4a-4088-9da2-73bd11cd8663 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:21.956540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ba52f5b1-cd4a-4088-9da2-73bd11cd8663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:22.069057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52f5b1-cd4a-4088-9da2-73bd11cd8663 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:22.139141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:22.146864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1f943-0685-4668-9354-a1162440a633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:22.147516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1f943-0685-4668-9354-a1162440a633 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:22.147804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1f943-0685-4668-9354-a1162440a633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:22.148074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1f943-0685-4668-9354-a1162440a633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:22.149745 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-00f1f943-0685-4668-9354-a1162440a633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:22.266197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1f943-0685-4668-9354-a1162440a633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:22.267653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1f943-0685-4668-9354-a1162440a633 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:22.287362 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 727/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:24.371634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224d7ca-0fc9-4f8e-8e31-927ce63ff17a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:24.372258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224d7ca-0fc9-4f8e-8e31-927ce63ff17a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:24.372258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224d7ca-0fc9-4f8e-8e31-927ce63ff17a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:24.373815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:24.381027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0152-4a97-41e2-8ad9-1c18eb0fc119 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:24.381776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0152-4a97-41e2-8ad9-1c18eb0fc119 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:24.381948 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0152-4a97-41e2-8ad9-1c18eb0fc119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:24.454598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1a5a0152-4a97-41e2-8ad9-1c18eb0fc119 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:24.456302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1a5a0152-4a97-41e2-8ad9-1c18eb0fc119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:24.524432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:24.574702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:24.613357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224d7ca-0fc9-4f8e-8e31-927ce63ff17a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:24.615080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f224d7ca-0fc9-4f8e-8e31-927ce63ff17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:24.731676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224d7ca-0fc9-4f8e-8e31-927ce63ff17a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:24.786400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:24.813926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c988bb0-4062-4243-aa44-5e132c79103e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:24.814577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c988bb0-4062-4243-aa44-5e132c79103e service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:24.814862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c988bb0-4062-4243-aa44-5e132c79103e service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:24.815137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c988bb0-4062-4243-aa44-5e132c79103e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:24.816958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2c988bb0-4062-4243-aa44-5e132c79103e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:24.938248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c988bb0-4062-4243-aa44-5e132c79103e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:24.939700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c988bb0-4062-4243-aa44-5e132c79103e service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:24.960146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 742/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:34.572481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=22 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:34.957495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=66 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:44.852627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6738-4fef-41a2-9700-fc5ea846bc04 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:44.853254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6738-4fef-41a2-9700-fc5ea846bc04 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:44.853254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6738-4fef-41a2-9700-fc5ea846bc04 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:44.854599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 729/1471] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:44.861101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624cba-d972-4b52-8c90-dea36815633b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:44.861839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624cba-d972-4b52-8c90-dea36815633b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:44.861999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624cba-d972-4b52-8c90-dea36815633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:44.935341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4c624cba-d972-4b52-8c90-dea36815633b None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:44.936574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4c624cba-d972-4b52-8c90-dea36815633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:45.042737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 743/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:45.134378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8062c-a645-426f-999f-feed6b6d579f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:45.134662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8062c-a645-426f-999f-feed6b6d579f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:45.134937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8062c-a645-426f-999f-feed6b6d579f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:45.136312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 730/1473] 10.222.0.27 () {54 vars in 962 bytes} [Thu Jul 14 09:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:45.141407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f4d5b-0fa7-4156-913a-ced698a7edb4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:45.141709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f4d5b-0fa7-4156-913a-ced698a7edb4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:45.141991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f4d5b-0fa7-4156-913a-ced698a7edb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:45.221358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-696f4d5b-0fa7-4156-913a-ced698a7edb4 None None] MFA Rules not processed for user `ebf4ab9d717e4c838d68590336074f09`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:45.222587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-696f4d5b-0fa7-4156-913a-ced698a7edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:45.244550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:45.302946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 744/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Jul 14 09:12:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:45.310462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8062c-a645-426f-999f-feed6b6d579f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:45.312036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a1a8062c-a645-426f-999f-feed6b6d579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:45.428319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8062c-a645-426f-999f-feed6b6d579f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:45.513770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e65bce-0594-4f0d-8d4f-d5e0924cadb2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf4ab9d717e4c838d68590336074f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:45.514652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e65bce-0594-4f0d-8d4f-d5e0924cadb2 service glance] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:45.515014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e65bce-0594-4f0d-8d4f-d5e0924cadb2 service glance] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:45.515367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e65bce-0594-4f0d-8d4f-d5e0924cadb2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:45.517407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d6e65bce-0594-4f0d-8d4f-d5e0924cadb2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:45.576342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:45.635401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e65bce-0594-4f0d-8d4f-d5e0924cadb2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:45.636786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e65bce-0594-4f0d-8d4f-d5e0924cadb2 service glance] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:45.656395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 731/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:47.782172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483f31-e442-4d13-9647-d7e35bb1d271 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:47.783097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483f31-e442-4d13-9647-d7e35bb1d271 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:47.783097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483f31-e442-4d13-9647-d7e35bb1d271 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:47.785215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 745/1476] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:12:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:47.794405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500a0c0-b2b4-4248-bbf7-ba43a51a465c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:47.795140 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500a0c0-b2b4-4248-bbf7-ba43a51a465c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:47.795320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500a0c0-b2b4-4248-bbf7-ba43a51a465c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:47.868477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6500a0c0-b2b4-4248-bbf7-ba43a51a465c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:47.869819 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6500a0c0-b2b4-4248-bbf7-ba43a51a465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:47.994816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 732/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:48.019005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b483f31-e442-4d13-9647-d7e35bb1d271 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:48.021564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5b483f31-e442-4d13-9647-d7e35bb1d271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:48.167357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b483f31-e442-4d13-9647-d7e35bb1d271 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:48.222162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:48.269523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57b038-7c14-4bcd-9f74-5f8c947c2336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:48.270188 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b038-7c14-4bcd-9f74-5f8c947c2336 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:48.270466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b038-7c14-4bcd-9f74-5f8c947c2336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:48.270735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b038-7c14-4bcd-9f74-5f8c947c2336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:48.271462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57b038-7c14-4bcd-9f74-5f8c947c2336 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:48.273299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-2e57b038-7c14-4bcd-9f74-5f8c947c2336 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:12:48.273299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 14 09:12:48.273299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: Jul 14 09:12:48.274764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57b038-7c14-4bcd-9f74-5f8c947c2336 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:48.294150 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 746/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jul 14 09:12:48 2022] GET /identity/v3/projects => generated 2553 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:12:50.341241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ee818-2d58-40f8-a351-843202a4d053 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:50.342120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ee818-2d58-40f8-a351-843202a4d053 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:50.342120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ee818-2d58-40f8-a351-843202a4d053 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:50.344600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 733/1479] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:12:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:50.350098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9534-cffe-49e7-8ddf-e024934eb9b0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:50.350539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9534-cffe-49e7-8ddf-e024934eb9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:50.350655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9534-cffe-49e7-8ddf-e024934eb9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:50.427243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-229a9534-cffe-49e7-8ddf-e024934eb9b0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:50.428506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-229a9534-cffe-49e7-8ddf-e024934eb9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:50.535060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 747/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:12:50.583896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ee818-2d58-40f8-a351-843202a4d053 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:50.585459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-647ee818-2d58-40f8-a351-843202a4d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:50.595990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:50.866175 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ee818-2d58-40f8-a351-843202a4d053 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:50.958837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:50.996172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb3244-6a6d-45ba-8df3-339407e40ddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:50.996855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb3244-6a6d-45ba-8df3-339407e40ddc service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:50.997135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb3244-6a6d-45ba-8df3-339407e40ddc service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:50.997412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb3244-6a6d-45ba-8df3-339407e40ddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:50.999054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d5bb3244-6a6d-45ba-8df3-339407e40ddc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:51.096074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb3244-6a6d-45ba-8df3-339407e40ddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:51.097690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb3244-6a6d-45ba-8df3-339407e40ddc service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:51.116149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 734/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:53.286618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40002fc5-3e51-48b8-8ff6-be4838a8b1d7 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:53.287485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40002fc5-3e51-48b8-8ff6-be4838a8b1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:53.287485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40002fc5-3e51-48b8-8ff6-be4838a8b1d7 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:53.290280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 748/1482] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:12:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:53.297766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fc663-2940-4e38-8c66-6cbb9e962681 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:53.298529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fc663-2940-4e38-8c66-6cbb9e962681 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:53.298690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fc663-2940-4e38-8c66-6cbb9e962681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:53.370519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-117fc663-2940-4e38-8c66-6cbb9e962681 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:53.371711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-117fc663-2940-4e38-8c66-6cbb9e962681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:53.421495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:53.484706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 735/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:53.521348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40002fc5-3e51-48b8-8ff6-be4838a8b1d7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:53.522911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-40002fc5-3e51-48b8-8ff6-be4838a8b1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:53.548761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:53.631459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40002fc5-3e51-48b8-8ff6-be4838a8b1d7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:53.709798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcb5f3-5931-45ff-83ab-3d4cc76355e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:53.710455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb5f3-5931-45ff-83ab-3d4cc76355e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:53.710731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb5f3-5931-45ff-83ab-3d4cc76355e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:53.710999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb5f3-5931-45ff-83ab-3d4cc76355e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:53.712642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8adcb5f3-5931-45ff-83ab-3d4cc76355e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:53.801272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:53.839615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb5f3-5931-45ff-83ab-3d4cc76355e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:53.841128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb5f3-5931-45ff-83ab-3d4cc76355e7 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:53.859837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 749/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:55.933885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62ec4d-81c0-419d-82e9-f6e4f8743890 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:55.934745 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62ec4d-81c0-419d-82e9-f6e4f8743890 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:55.934745 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62ec4d-81c0-419d-82e9-f6e4f8743890 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:55.937027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 736/1485] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:12:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:55.945949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9efc-9e42-454f-95dc-3a4fe140329d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:55.946689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9efc-9e42-454f-95dc-3a4fe140329d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:55.947032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9efc-9e42-454f-95dc-3a4fe140329d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:56.020711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-791d9efc-9e42-454f-95dc-3a4fe140329d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:56.021958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-791d9efc-9e42-454f-95dc-3a4fe140329d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:56.131503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 750/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:56.170502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62ec4d-81c0-419d-82e9-f6e4f8743890 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:56.173078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-af62ec4d-81c0-419d-82e9-f6e4f8743890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:56.291309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62ec4d-81c0-419d-82e9-f6e4f8743890 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:56.366729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:56.369130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad532120-7800-4eef-82cb-6ff4e57af3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:56.369801 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad532120-7800-4eef-82cb-6ff4e57af3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:56.370094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad532120-7800-4eef-82cb-6ff4e57af3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:56.370381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad532120-7800-4eef-82cb-6ff4e57af3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:56.372475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ad532120-7800-4eef-82cb-6ff4e57af3d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:56.494714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad532120-7800-4eef-82cb-6ff4e57af3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:56.496152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad532120-7800-4eef-82cb-6ff4e57af3d3 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:56.514768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 737/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:12:58.624147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aaf75-a727-4b29-9b1f-ed1891291da9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:58.625109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aaf75-a727-4b29-9b1f-ed1891291da9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:58.625109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aaf75-a727-4b29-9b1f-ed1891291da9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:58.627225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 751/1488] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:12:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:12:58.633634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df974d-242d-4bd1-8e93-ad8c89e61e0f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:58.634114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df974d-242d-4bd1-8e93-ad8c89e61e0f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:58.634244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df974d-242d-4bd1-8e93-ad8c89e61e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:58.711665 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e5df974d-242d-4bd1-8e93-ad8c89e61e0f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:12:58.712957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e5df974d-242d-4bd1-8e93-ad8c89e61e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:58.768799 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:58.817608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 738/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:12:58.860623 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aaf75-a727-4b29-9b1f-ed1891291da9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:12:58.862192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e44aaf75-a727-4b29-9b1f-ed1891291da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:58.901190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:58.973156 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aaf75-a727-4b29-9b1f-ed1891291da9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:12:59.053625 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f47d-2d0f-4a88-99d8-ec9628958c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:12:59.054281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f47d-2d0f-4a88-99d8-ec9628958c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:12:59.054544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f47d-2d0f-4a88-99d8-ec9628958c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:12:59.054853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f47d-2d0f-4a88-99d8-ec9628958c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:12:59.056520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7385f47d-2d0f-4a88-99d8-ec9628958c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:12:59.148266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:12:59.178447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385f47d-2d0f-4a88-99d8-ec9628958c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:12:59.179856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385f47d-2d0f-4a88-99d8-ec9628958c1a service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:12:59.199609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 752/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:13:01.405047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a4b28-1fc1-4dbc-98ea-53135dcb5111 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:13:01.405558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a4b28-1fc1-4dbc-98ea-53135dcb5111 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:13:01.405558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a4b28-1fc1-4dbc-98ea-53135dcb5111 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:13:01.406989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 739/1491] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jul 14 09:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:13:01.413520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260697f-9abb-4afe-848d-2305887608c0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:13:01.413986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260697f-9abb-4afe-848d-2305887608c0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:13:01.414100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260697f-9abb-4afe-848d-2305887608c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:13:01.493280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1260697f-9abb-4afe-848d-2305887608c0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:13:01.495101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1260697f-9abb-4afe-848d-2305887608c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:13:01.603647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 753/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jul 14 09:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:13:01.649293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a4b28-1fc1-4dbc-98ea-53135dcb5111 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:13:01.650906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-189a4b28-1fc1-4dbc-98ea-53135dcb5111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:13:01.770506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a4b28-1fc1-4dbc-98ea-53135dcb5111 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:13:01.849289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf239e-8946-491e-a7e2-fac6ad4f0907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:13:01.849933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf239e-8946-491e-a7e2-fac6ad4f0907 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:13:01.850220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf239e-8946-491e-a7e2-fac6ad4f0907 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:13:01.850489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf239e-8946-491e-a7e2-fac6ad4f0907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:13:01.852131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0faf239e-8946-491e-a7e2-fac6ad4f0907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:13:01.862002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:13:01.980801 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf239e-8946-491e-a7e2-fac6ad4f0907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:13:01.982724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf239e-8946-491e-a7e2-fac6ad4f0907 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:13:02.003402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 740/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:13:11.601973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=82 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:13:12.000244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=50 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:28.493589 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1bf57-75ad-429f-8dbf-16c19945c862 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:28.494472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1bf57-75ad-429f-8dbf-16c19945c862 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:28.494472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1bf57-75ad-429f-8dbf-16c19945c862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:28.574920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4ff1bf57-75ad-429f-8dbf-16c19945c862 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:14:28.576147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4ff1bf57-75ad-429f-8dbf-16c19945c862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:28.682742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 754/1494] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:14:28.691183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f46ee4-3347-47a7-953f-3b26f3ec3537 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:28.691697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f46ee4-3347-47a7-953f-3b26f3ec3537 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:28.691697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f46ee4-3347-47a7-953f-3b26f3ec3537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:28.771500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-72f46ee4-3347-47a7-953f-3b26f3ec3537 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:14:28.772711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-72f46ee4-3347-47a7-953f-3b26f3ec3537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:28.879335 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 741/1495] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:14:28.884452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1bf57-75ad-429f-8dbf-16c19945c862 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:14:28.885752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4ff1bf57-75ad-429f-8dbf-16c19945c862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:28.898980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1bf57-75ad-429f-8dbf-16c19945c862 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:14:28.975879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:29.013984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:14:29.014664 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:29.014943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:29.015214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:29.015943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:14:29.016248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:14:29.017309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:14:29.017309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 14 09:14:29.017309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: Jul 14 09:14:29.018781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:14:29.030622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 755/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:14:29.039107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f46ee4-3347-47a7-953f-3b26f3ec3537 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:14:29.048859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f46ee4-3347-47a7-953f-3b26f3ec3537 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:14:29.117254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:29.152984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c0d8b-4a54-493f-92cd-989220a9d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:14:29.153651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c0d8b-4a54-493f-92cd-989220a9d090 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:29.153936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c0d8b-4a54-493f-92cd-989220a9d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:29.154205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c0d8b-4a54-493f-92cd-989220a9d090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:29.154889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c0d8b-4a54-493f-92cd-989220a9d090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:14:29.156651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-512c0d8b-4a54-493f-92cd-989220a9d090 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:14:29.156651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 14 09:14:29.156651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: Jul 14 09:14:29.157867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c0d8b-4a54-493f-92cd-989220a9d090 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:14:29.222730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 742/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:14:29 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:14:29.227462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:14:29.228982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:29.267278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b529aa-423c-43ab-8182-ae86e969c05c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:14:29.368152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e72a29-7deb-43b6-9894-6a8102126da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:14:29.368875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e72a29-7deb-43b6-9894-6a8102126da8 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:29.369152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e72a29-7deb-43b6-9894-6a8102126da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:29.369405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e72a29-7deb-43b6-9894-6a8102126da8 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:29.370100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e72a29-7deb-43b6-9894-6a8102126da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:14:29.371112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-e9e72a29-7deb-43b6-9894-6a8102126da8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:14:29.371112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 14 09:14:29.371112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: Jul 14 09:14:29.372314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e72a29-7deb-43b6-9894-6a8102126da8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:14:29.418719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 756/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:14:29 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:14:29.423039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c0d8b-4a54-493f-92cd-989220a9d090 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:14:29.425133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-512c0d8b-4a54-493f-92cd-989220a9d090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:29.489252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c0d8b-4a54-493f-92cd-989220a9d090 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:14:29.594352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:29.607815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a2790-f269-46a9-ab7e-fa2512f903eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:14:29.608558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2790-f269-46a9-ab7e-fa2512f903eb admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:29.608873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2790-f269-46a9-ab7e-fa2512f903eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:29.609145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2790-f269-46a9-ab7e-fa2512f903eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:29.609965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a2790-f269-46a9-ab7e-fa2512f903eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:14:29.611079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-c47a2790-f269-46a9-ab7e-fa2512f903eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:14:29.611079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 14 09:14:29.611079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: Jul 14 09:14:29.612109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a2790-f269-46a9-ab7e-fa2512f903eb admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:14:29.626297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 743/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:14:29.630762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e72a29-7deb-43b6-9894-6a8102126da8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:14:29.632357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e9e72a29-7deb-43b6-9894-6a8102126da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:29.644636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e72a29-7deb-43b6-9894-6a8102126da8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:14:29.671551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:29.748760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23196fa-fa81-4719-baf2-1009dfb380db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:14:29.749392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23196fa-fa81-4719-baf2-1009dfb380db admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:29.749672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23196fa-fa81-4719-baf2-1009dfb380db admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:29.749947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23196fa-fa81-4719-baf2-1009dfb380db admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:29.750687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23196fa-fa81-4719-baf2-1009dfb380db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:14:29.751710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-a23196fa-fa81-4719-baf2-1009dfb380db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:14:29.751710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 14 09:14:29.751710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: Jul 14 09:14:29.752607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23196fa-fa81-4719-baf2-1009dfb380db admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:14:29.765760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 757/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:14:29.771076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a2790-f269-46a9-ab7e-fa2512f903eb admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:14:29.773157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c47a2790-f269-46a9-ab7e-fa2512f903eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:29.830571 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a2790-f269-46a9-ab7e-fa2512f903eb admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:14:29.933199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bf76e-d37e-4a12-a4d2-cd2d32763b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:14:29.934104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bf76e-d37e-4a12-a4d2-cd2d32763b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:29.934385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bf76e-d37e-4a12-a4d2-cd2d32763b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:29.934653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bf76e-d37e-4a12-a4d2-cd2d32763b08 admin admin] PATH_INFO: `/v3/projects/1682c58dfc0c4735908a6b432896a340/users/9468f74ee7784a37aac6e421b7376a68/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:29.959066 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bf76e-d37e-4a12-a4d2-cd2d32763b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1682c58dfc0c4735908a6b432896a340, user_id=9468f74ee7784a37aac6e421b7376a68, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:14:29.960102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-c90bf76e-d37e-4a12-a4d2-cd2d32763b08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:14:29.960102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 14 09:14:29.960102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: Jul 14 09:14:29.962070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bf76e-d37e-4a12-a4d2-cd2d32763b08 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:14:29.990416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 744/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:14:29 2022] PUT /identity/v3/projects/1682c58dfc0c4735908a6b432896a340/users/9468f74ee7784a37aac6e421b7376a68/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:14:30.003176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b041d-947b-4802-9a8c-26f70149196e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:30.003355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b041d-947b-4802-9a8c-26f70149196e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:30.003661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b041d-947b-4802-9a8c-26f70149196e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:30.062839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-140b041d-947b-4802-9a8c-26f70149196e None None] MFA Rules not processed for user `9468f74ee7784a37aac6e421b7376a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:14:30.064050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-140b041d-947b-4802-9a8c-26f70149196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:30.149876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 758/1502] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:14:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:14:30.164052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac1741-30e5-43a5-aeb1-f3d2a5e250cb None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:30.164343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac1741-30e5-43a5-aeb1-f3d2a5e250cb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:30.164618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac1741-30e5-43a5-aeb1-f3d2a5e250cb None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:30.166058 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 745/1503] 10.222.0.27 () {54 vars in 963 bytes} [Thu Jul 14 09:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:14:30.171006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493e9db-b999-49a6-a821-9cad1ab8ddb0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:30.171295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493e9db-b999-49a6-a821-9cad1ab8ddb0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:30.171577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493e9db-b999-49a6-a821-9cad1ab8ddb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:30.207947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:30.261536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0493e9db-b999-49a6-a821-9cad1ab8ddb0 None None] MFA Rules not processed for user `4f9b12f6e7e347e19e5183d7e45b162f`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:14:30.262668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0493e9db-b999-49a6-a821-9cad1ab8ddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:30.343433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 759/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Thu Jul 14 09:14:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:14:30.351907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac1741-30e5-43a5-aeb1-f3d2a5e250cb None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:14:30.354307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a9ac1741-30e5-43a5-aeb1-f3d2a5e250cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:30.412353 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:30.476191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac1741-30e5-43a5-aeb1-f3d2a5e250cb None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:14:30.556328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae701e-accf-4656-b022-13bc2178a87d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:14:30.556937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae701e-accf-4656-b022-13bc2178a87d service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:30.557217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae701e-accf-4656-b022-13bc2178a87d service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:30.557486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae701e-accf-4656-b022-13bc2178a87d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:30.559125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-47ae701e-accf-4656-b022-13bc2178a87d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:30.667992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae701e-accf-4656-b022-13bc2178a87d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:14:30.669485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae701e-accf-4656-b022-13bc2178a87d service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:14:30.672952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:30.688377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 746/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:14:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:14:30.731548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280706b-b5bf-4d15-bcc1-92c704b5e9b2 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:30.731966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280706b-b5bf-4d15-bcc1-92c704b5e9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:30.732121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280706b-b5bf-4d15-bcc1-92c704b5e9b2 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:30.733441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 760/1506] 10.222.0.27 () {52 vars in 829 bytes} [Thu Jul 14 09:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:14:30.738019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae701e-accf-4656-b022-13bc2178a87d service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:14:30.739288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-47ae701e-accf-4656-b022-13bc2178a87d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:30.843571 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae701e-accf-4656-b022-13bc2178a87d service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:14:30.945679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:14:30.946564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:30.946845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:30.947118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] PATH_INFO: `/v3/users/9468f74ee7784a37aac6e421b7376a68` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:30.961319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9468f74ee7784a37aac6e421b7376a68)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:14:30.962363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:14:30.962363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 14 09:14:30.962363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: Jul 14 09:14:30.963581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:14:30.974116 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:31.034510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9468f74ee7784a37aac6e421b7376a68'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:14:31.034944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9468f74ee7784a37aac6e421b7376a68'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:14:31.047759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9468f74ee7784a37aac6e421b7376a68'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:14:31.061011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9468f74ee7784a37aac6e421b7376a68'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:14:31.061532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9468f74ee7784a37aac6e421b7376a68'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:14:31.086426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 747/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:14:30 2022] DELETE /identity/v3/users/9468f74ee7784a37aac6e421b7376a68 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:14:31.091128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1175b76-ebe9-49bb-bb33-ea4b4a2c91b3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:31.091419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1175b76-ebe9-49bb-bb33-ea4b4a2c91b3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:31.091697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1175b76-ebe9-49bb-bb33-ea4b4a2c91b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:31.151078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f1175b76-ebe9-49bb-bb33-ea4b4a2c91b3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:14:31.152197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f1175b76-ebe9-49bb-bb33-ea4b4a2c91b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:31.248957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:31.263392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 761/1508] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:14:31.273990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:14:31.275229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:31.386579 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b1e80-6ab4-4496-81bd-9c44e3131520 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:14:31.454410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:31.476626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaed53-0075-4e9a-84e4-117a3f52941e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:14:31.477319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaed53-0075-4e9a-84e4-117a3f52941e service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:31.477597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaed53-0075-4e9a-84e4-117a3f52941e service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:31.477864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaed53-0075-4e9a-84e4-117a3f52941e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:31.479498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2ffaed53-0075-4e9a-84e4-117a3f52941e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:31.590525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaed53-0075-4e9a-84e4-117a3f52941e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:14:31.591992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaed53-0075-4e9a-84e4-117a3f52941e service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:14:31.610701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 748/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:14:31.962457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1175b76-ebe9-49bb-bb33-ea4b4a2c91b3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:14:31.963852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f1175b76-ebe9-49bb-bb33-ea4b4a2c91b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:14:31.979143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1175b76-ebe9-49bb-bb33-ea4b4a2c91b3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:14:32.080941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:14:32.081846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:14:32.082129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:14:32.082404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] PATH_INFO: `/v3/projects/1682c58dfc0c4735908a6b432896a340` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:14:32.094529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1682c58dfc0c4735908a6b432896a340)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:14:32.095960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:14:32.095960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 14 09:14:32.095960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: Jul 14 09:14:32.098003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:14:32.167030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1682c58dfc0c4735908a6b432896a340', 'request_id': 'req-fb639b78-99e2-423f-9a19-b2a191ad64f2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:14:32.173739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1682c58dfc0c4735908a6b432896a340', 'request_id': 'req-fb639b78-99e2-423f-9a19-b2a191ad64f2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:14:32.184202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1682c58dfc0c4735908a6b432896a340', 'request_id': 'req-fb639b78-99e2-423f-9a19-b2a191ad64f2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:14:32.218315 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] The token cache is being invalidate because project 1682c58dfc0c4735908a6b432896a340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:14:32.218514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:14:32.219026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb639b78-99e2-423f-9a19-b2a191ad64f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:14:32.220397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 762/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:14:31 2022] DELETE /identity/v3/projects/1682c58dfc0c4735908a6b432896a340 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:14:41.608361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=62 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:14:42.216192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:16:22.808937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6531d-8efa-4fc8-b08c-747ad50ebf31 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:22.809441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6531d-8efa-4fc8-b08c-747ad50ebf31 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:22.809558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6531d-8efa-4fc8-b08c-747ad50ebf31 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:22.811713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:16:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:16:22.817924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997bae7-749e-4f60-80f8-6946c5faa7be None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:22.818410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997bae7-749e-4f60-80f8-6946c5faa7be None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:22.818519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997bae7-749e-4f60-80f8-6946c5faa7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:23.027940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f997bae7-749e-4f60-80f8-6946c5faa7be None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:16:23.029191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f997bae7-749e-4f60-80f8-6946c5faa7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:23.153359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:16:23.318033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6531d-8efa-4fc8-b08c-747ad50ebf31 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:16:23.320870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8dc6531d-8efa-4fc8-b08c-747ad50ebf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:23.477493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6531d-8efa-4fc8-b08c-747ad50ebf31 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:16:23.484251 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc24f-d36f-47a2-8e6e-3fa96ff2ae25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:16:23.484947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc24f-d36f-47a2-8e6e-3fa96ff2ae25 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:23.485232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc24f-d36f-47a2-8e6e-3fa96ff2ae25 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:23.485504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc24f-d36f-47a2-8e6e-3fa96ff2ae25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:23.494722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc24f-d36f-47a2-8e6e-3fa96ff2ae25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:16:23.496362 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc24f-d36f-47a2-8e6e-3fa96ff2ae25 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:16:23.506510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 750/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:16:24.011665 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e8f8-5130-470a-ae37-24fdf54b653c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:24.012282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e8f8-5130-470a-ae37-24fdf54b653c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:24.012282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e8f8-5130-470a-ae37-24fdf54b653c None None] PATH_INFO: `/v3` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:24.013798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 764/1514] 10.222.0.47 () {54 vars in 925 bytes} [Thu Jul 14 09:16:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:16:24.020546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc4b26-b6fe-4892-9a10-a8e3165903aa None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:24.021034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc4b26-b6fe-4892-9a10-a8e3165903aa None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:24.021148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc4b26-b6fe-4892-9a10-a8e3165903aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:24.087268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a4fc4b26-b6fe-4892-9a10-a8e3165903aa None None] MFA Rules not processed for user `58986e97f4d849aba35149d3666db015`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:16:24.088533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a4fc4b26-b6fe-4892-9a10-a8e3165903aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:24.158421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:16:24.164318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 751/1515] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jul 14 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:16:24.352165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021a22-53ae-46a6-b4df-53a52086e781 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:24.352509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021a22-53ae-46a6-b4df-53a52086e781 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:24.352716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021a22-53ae-46a6-b4df-53a52086e781 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:24.354234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 765/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:16:24.360272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9468b-7765-4e72-a402-863da590c71a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:24.360621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9468b-7765-4e72-a402-863da590c71a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:24.360932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9468b-7765-4e72-a402-863da590c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:24.382838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fba9468b-7765-4e72-a402-863da590c71a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:16:24.384120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fba9468b-7765-4e72-a402-863da590c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:24.393526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 752/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:16:24.547130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50021a22-53ae-46a6-b4df-53a52086e781 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:16:24.561933 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50021a22-53ae-46a6-b4df-53a52086e781 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:16:24.567927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7012e0f-9bec-44b8-add9-86051b2de8c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:16:24.568591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012e0f-9bec-44b8-add9-86051b2de8c9 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:24.568921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012e0f-9bec-44b8-add9-86051b2de8c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:24.569204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012e0f-9bec-44b8-add9-86051b2de8c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:24.577685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7012e0f-9bec-44b8-add9-86051b2de8c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:16:24.579296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7012e0f-9bec-44b8-add9-86051b2de8c9 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:16:24.589089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 766/1518] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:16:33.141887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee305f-0c35-444b-8cdf-87316504ed17 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:33.142467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee305f-0c35-444b-8cdf-87316504ed17 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:33.142467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee305f-0c35-444b-8cdf-87316504ed17 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:33.143730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 753/1519] 10.222.0.27 () {54 vars in 960 bytes} [Thu Jul 14 09:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:16:33.150179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bc565-72e2-4a4f-8ef1-7a585ed61ab2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:33.150930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bc565-72e2-4a4f-8ef1-7a585ed61ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:33.151105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bc565-72e2-4a4f-8ef1-7a585ed61ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:33.171885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-da8bc565-72e2-4a4f-8ef1-7a585ed61ab2 None None] MFA Rules not processed for user `58986e97f4d849aba35149d3666db015`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:16:33.173180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-da8bc565-72e2-4a4f-8ef1-7a585ed61ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:33.183096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 767/1520] 10.222.0.27 () {58 vars in 1057 bytes} [Thu Jul 14 09:16:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:16:33.190698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee305f-0c35-444b-8cdf-87316504ed17 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:16:33.206890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee305f-0c35-444b-8cdf-87316504ed17 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:16:33.212112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a403d-2f4c-423d-8a7f-913d250b0699 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:16:33.212805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a403d-2f4c-423d-8a7f-913d250b0699 service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:33.213090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a403d-2f4c-423d-8a7f-913d250b0699 service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:33.213361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a403d-2f4c-423d-8a7f-913d250b0699 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:33.222450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a403d-2f4c-423d-8a7f-913d250b0699 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:16:33.224033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a403d-2f4c-423d-8a7f-913d250b0699 service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:16:33.233879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 754/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:16:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:16:35.854221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657564-55b7-4479-8692-c11125051f8d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:35.855160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657564-55b7-4479-8692-c11125051f8d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:35.855160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657564-55b7-4479-8692-c11125051f8d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:35.857334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:16:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:16:35.862360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411bb33-8bbc-4fcc-a262-c656a6f15b20 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:35.862806 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411bb33-8bbc-4fcc-a262-c656a6f15b20 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:35.862917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411bb33-8bbc-4fcc-a262-c656a6f15b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:35.885817 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d411bb33-8bbc-4fcc-a262-c656a6f15b20 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:16:35.887033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d411bb33-8bbc-4fcc-a262-c656a6f15b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:35.896391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:16:36.054043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657564-55b7-4479-8692-c11125051f8d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:16:36.074215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657564-55b7-4479-8692-c11125051f8d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:16:36.081047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6af2c-d590-473c-abeb-cbfa996ac0e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:16:36.081688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6af2c-d590-473c-abeb-cbfa996ac0e7 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:36.081966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6af2c-d590-473c-abeb-cbfa996ac0e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:36.082218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6af2c-d590-473c-abeb-cbfa996ac0e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:36.091250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6af2c-d590-473c-abeb-cbfa996ac0e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:16:36.092877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6af2c-d590-473c-abeb-cbfa996ac0e7 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:16:36.102812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 769/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:16:36.950969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13013-a3cf-4ff9-bcad-16efdbf6fc38 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:36.951593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13013-a3cf-4ff9-bcad-16efdbf6fc38 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:36.951593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13013-a3cf-4ff9-bcad-16efdbf6fc38 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:36.953378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:16:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:16:36.961233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5d3d-07f5-4404-9d44-0344a0d16823 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:36.961685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5d3d-07f5-4404-9d44-0344a0d16823 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:36.961834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5d3d-07f5-4404-9d44-0344a0d16823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:36.993283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-492a5d3d-07f5-4404-9d44-0344a0d16823 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:16:36.994497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-492a5d3d-07f5-4404-9d44-0344a0d16823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:37.007141 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:16:37.194649 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee13013-a3cf-4ff9-bcad-16efdbf6fc38 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:16:37.216172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee13013-a3cf-4ff9-bcad-16efdbf6fc38 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:16:37.222366 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac2dc5-810c-47f9-9653-745505d15f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:16:37.223038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac2dc5-810c-47f9-9653-745505d15f7a service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:37.223327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac2dc5-810c-47f9-9653-745505d15f7a service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:37.223597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac2dc5-810c-47f9-9653-745505d15f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:37.235355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac2dc5-810c-47f9-9653-745505d15f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:16:37.237005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac2dc5-810c-47f9-9653-745505d15f7a service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:16:37.248386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 757/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:16:41.222951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b53f-9ae4-4ffd-8e6b-00d0938de5e6 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:41.223717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b53f-9ae4-4ffd-8e6b-00d0938de5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:41.223717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b53f-9ae4-4ffd-8e6b-00d0938de5e6 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:41.225056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:16:41.232048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e5cbe-2cdb-47b4-9283-d5090f4d9c65 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:41.232499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e5cbe-2cdb-47b4-9283-d5090f4d9c65 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:41.232869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e5cbe-2cdb-47b4-9283-d5090f4d9c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:41.258098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2a4e5cbe-2cdb-47b4-9283-d5090f4d9c65 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:16:41.259351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2a4e5cbe-2cdb-47b4-9283-d5090f4d9c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:41.269106 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:16:41.343677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b53f-9ae4-4ffd-8e6b-00d0938de5e6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:16:41.345790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e8e3b53f-9ae4-4ffd-8e6b-00d0938de5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:41.382318 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:16:41.443753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b53f-9ae4-4ffd-8e6b-00d0938de5e6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:16:41.448584 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb8c8c-9205-411c-a94c-19aa96b5d525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:16:41.449271 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb8c8c-9205-411c-a94c-19aa96b5d525 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:41.449555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb8c8c-9205-411c-a94c-19aa96b5d525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:41.449829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb8c8c-9205-411c-a94c-19aa96b5d525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:41.460233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb8c8c-9205-411c-a94c-19aa96b5d525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:16:41.461747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb8c8c-9205-411c-a94c-19aa96b5d525 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:16:41.471982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 772/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:16:43.501335 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ac9b5-3c7f-4312-a6e5-04f057e79979 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:43.501940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ac9b5-3c7f-4312-a6e5-04f057e79979 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:43.501940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ac9b5-3c7f-4312-a6e5-04f057e79979 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:43.504057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:16:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:16:43.510841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff96e7-dd9a-4686-8b47-22ede3be6d5c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:43.511277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff96e7-dd9a-4686-8b47-22ede3be6d5c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:43.511414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff96e7-dd9a-4686-8b47-22ede3be6d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:43.537135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-11ff96e7-dd9a-4686-8b47-22ede3be6d5c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:16:43.538354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-11ff96e7-dd9a-4686-8b47-22ede3be6d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:43.547722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:16:43.584038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ac9b5-3c7f-4312-a6e5-04f057e79979 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:16:43.598774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ac9b5-3c7f-4312-a6e5-04f057e79979 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:16:43.603188 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178694d5-34b8-4615-9ab5-c070bc2a2079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:16:43.603833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178694d5-34b8-4615-9ab5-c070bc2a2079 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:43.604112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178694d5-34b8-4615-9ab5-c070bc2a2079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:43.604381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178694d5-34b8-4615-9ab5-c070bc2a2079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:43.614426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178694d5-34b8-4615-9ab5-c070bc2a2079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:16:43.615864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178694d5-34b8-4615-9ab5-c070bc2a2079 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:16:43.625740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 760/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:16:47.216056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e225c-9d4f-470a-9bbb-9e8627c5189a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:47.216942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e225c-9d4f-470a-9bbb-9e8627c5189a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:47.216942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e225c-9d4f-470a-9bbb-9e8627c5189a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:47.219209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:16:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:16:47.225061 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacca19-5047-450b-9a1a-b5fd65de746d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:47.225508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacca19-5047-450b-9a1a-b5fd65de746d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:47.225618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacca19-5047-450b-9a1a-b5fd65de746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:47.245994 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2eacca19-5047-450b-9a1a-b5fd65de746d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:16:47.247236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2eacca19-5047-450b-9a1a-b5fd65de746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:47.256958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:16:47.559976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e225c-9d4f-470a-9bbb-9e8627c5189a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:16:47.562999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-339e225c-9d4f-470a-9bbb-9e8627c5189a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:47.651739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e225c-9d4f-470a-9bbb-9e8627c5189a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:16:47.655637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a6aca-159a-4d8b-808f-db8e26067531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:16:47.656277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a6aca-159a-4d8b-808f-db8e26067531 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:47.656554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a6aca-159a-4d8b-808f-db8e26067531 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:47.656856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a6aca-159a-4d8b-808f-db8e26067531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:47.667513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a6aca-159a-4d8b-808f-db8e26067531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:16:47.669017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a6aca-159a-4d8b-808f-db8e26067531 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:16:47.679037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 775/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:16:49.733572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c0949-f8da-4295-ac98-a059ed8f762e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:49.734205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c0949-f8da-4295-ac98-a059ed8f762e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:49.734205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c0949-f8da-4295-ac98-a059ed8f762e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:49.735585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:16:49.744075 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ab6ac-136e-4d1e-b769-dea64958119a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:49.744828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ab6ac-136e-4d1e-b769-dea64958119a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:49.744999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ab6ac-136e-4d1e-b769-dea64958119a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:49.772424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-952ab6ac-136e-4d1e-b769-dea64958119a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:16:49.773679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-952ab6ac-136e-4d1e-b769-dea64958119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:49.782915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:16:50.085268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c0949-f8da-4295-ac98-a059ed8f762e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:16:50.087568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-216c0949-f8da-4295-ac98-a059ed8f762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:16:50.102232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c0949-f8da-4295-ac98-a059ed8f762e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:16:50.106240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830f7d9-c0b5-4a31-a47f-57a7c30e6e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:16:50.106876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830f7d9-c0b5-4a31-a47f-57a7c30e6e82 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:16:50.107155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830f7d9-c0b5-4a31-a47f-57a7c30e6e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:16:50.107430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830f7d9-c0b5-4a31-a47f-57a7c30e6e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:16:50.117067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830f7d9-c0b5-4a31-a47f-57a7c30e6e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:16:50.118485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830f7d9-c0b5-4a31-a47f-57a7c30e6e82 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:16:50.128485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 763/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:16:59.766433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=63 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:17:00.123848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=37 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:23.164600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aed08-1e09-4f65-8784-022ec699cd4b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.165729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aed08-1e09-4f65-8784-022ec699cd4b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.166242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aed08-1e09-4f65-8784-022ec699cd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.198053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ae1aed08-1e09-4f65-8784-022ec699cd4b None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.200309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ae1aed08-1e09-4f65-8784-022ec699cd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.214011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 777/1540] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:23.222922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5712-bb90-4d4d-8a12-de4666b1a7fb None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.223482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5712-bb90-4d4d-8a12-de4666b1a7fb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.223482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5712-bb90-4d4d-8a12-de4666b1a7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.254241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b83d5712-bb90-4d4d-8a12-de4666b1a7fb None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.255596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b83d5712-bb90-4d4d-8a12-de4666b1a7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.269002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 764/1541] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:18:23.274965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aed08-1e09-4f65-8784-022ec699cd4b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:23.290121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aed08-1e09-4f65-8784-022ec699cd4b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:23.301784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1607-5770-4af6-9144-38dff61c4523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:23.303020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1607-5770-4af6-9144-38dff61c4523 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.303838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1607-5770-4af6-9144-38dff61c4523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.304329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1607-5770-4af6-9144-38dff61c4523 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.305318 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1607-5770-4af6-9144-38dff61c4523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:23.305861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1607-5770-4af6-9144-38dff61c4523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:23.307769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1607-5770-4af6-9144-38dff61c4523 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:23.328860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 778/1542] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:23.336508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d5712-bb90-4d4d-8a12-de4666b1a7fb None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:23.346429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d5712-bb90-4d4d-8a12-de4666b1a7fb None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:23.357324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e7679-c2f8-4e62-bc4b-03962c32883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:23.358016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7679-c2f8-4e62-bc4b-03962c32883c admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.358299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7679-c2f8-4e62-bc4b-03962c32883c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.359164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e7679-c2f8-4e62-bc4b-03962c32883c admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.359881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e7679-c2f8-4e62-bc4b-03962c32883c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:23.361901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e7679-c2f8-4e62-bc4b-03962c32883c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:23.422431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 765/1543] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/projects => generated 357 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:23.426795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1607-5770-4af6-9144-38dff61c4523 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:23.432002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfab292-c412-4b53-9499-eb0cc4b19425 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.432298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfab292-c412-4b53-9499-eb0cc4b19425 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.432577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfab292-c412-4b53-9499-eb0cc4b19425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.444865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1607-5770-4af6-9144-38dff61c4523 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:23.458599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-adfab292-c412-4b53-9499-eb0cc4b19425 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.460494 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-adfab292-c412-4b53-9499-eb0cc4b19425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.534762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab09b7a-12f0-48d7-8502-5484fb435089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:23.536208 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09b7a-12f0-48d7-8502-5484fb435089 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.536497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09b7a-12f0-48d7-8502-5484fb435089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.536834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09b7a-12f0-48d7-8502-5484fb435089 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.537562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab09b7a-12f0-48d7-8502-5484fb435089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:23.539957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab09b7a-12f0-48d7-8502-5484fb435089 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:23.562343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 766/1544] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 14 09:18:23.573396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ab65-4c88-406e-9270-72407fd44851 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.573750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ab65-4c88-406e-9270-72407fd44851 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.573966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ab65-4c88-406e-9270-72407fd44851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.575247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 779/1545] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/users => generated 279 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:23.586050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab09b7a-12f0-48d7-8502-5484fb435089 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:23.603387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2f24ab65-4c88-406e-9270-72407fd44851 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.604621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2f24ab65-4c88-406e-9270-72407fd44851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.604768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab09b7a-12f0-48d7-8502-5484fb435089 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:23.617978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 767/1546] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:18:23.619654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0449c-8610-4433-b9d7-bc5ea0a9c4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:23.620404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0449c-8610-4433-b9d7-bc5ea0a9c4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.620702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0449c-8610-4433-b9d7-bc5ea0a9c4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.621312 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0449c-8610-4433-b9d7-bc5ea0a9c4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.622062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0449c-8610-4433-b9d7-bc5ea0a9c4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:23.623966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ab65-4c88-406e-9270-72407fd44851 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:23.624106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0449c-8610-4433-b9d7-bc5ea0a9c4c3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:23.634237 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ab65-4c88-406e-9270-72407fd44851 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:23.643606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 780/1547] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:18:23.643999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d509b36-9943-4864-9203-574e8932d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:23.644702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509b36-9943-4864-9203-574e8932d99c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.645064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509b36-9943-4864-9203-574e8932d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.645353 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509b36-9943-4864-9203-574e8932d99c admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.646077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d509b36-9943-4864-9203-574e8932d99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:23.646384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d509b36-9943-4864-9203-574e8932d99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:23.648081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-8d509b36-9943-4864-9203-574e8932d99c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:18:23.648081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 14 09:18:23.648081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: Jul 14 09:18:23.649015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d509b36-9943-4864-9203-574e8932d99c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:23.658579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0449c-8610-4433-b9d7-bc5ea0a9c4c3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:23.671189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 768/1548] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:18:23.672718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db23391-9b5a-4117-94fe-3d895b9da5b9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.675640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db23391-9b5a-4117-94fe-3d895b9da5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.675936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db23391-9b5a-4117-94fe-3d895b9da5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.679135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0449c-8610-4433-b9d7-bc5ea0a9c4c3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:23.696529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6eae9-db87-4a4d-970c-b55e85b76224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:23.696990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6db23391-9b5a-4117-94fe-3d895b9da5b9 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.697250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6eae9-db87-4a4d-970c-b55e85b76224 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.697612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6eae9-db87-4a4d-970c-b55e85b76224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.697891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6eae9-db87-4a4d-970c-b55e85b76224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.698201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6db23391-9b5a-4117-94fe-3d895b9da5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.698646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6eae9-db87-4a4d-970c-b55e85b76224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:23.700756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6eae9-db87-4a4d-970c-b55e85b76224 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:23.706334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 769/1549] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:23.707487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e057af-92de-45ad-a5fc-16732f6d4735 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.707777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e057af-92de-45ad-a5fc-16732f6d4735 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.708052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e057af-92de-45ad-a5fc-16732f6d4735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.720217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 781/1550] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:23.724201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b557245-1142-44c7-ad18-b85b6ce7e825 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.724493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b557245-1142-44c7-ad18-b85b6ce7e825 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.724830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b557245-1142-44c7-ad18-b85b6ce7e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.733725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-94e057af-92de-45ad-a5fc-16732f6d4735 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.734922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-94e057af-92de-45ad-a5fc-16732f6d4735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.744165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 770/1551] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:23.744776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5b557245-1142-44c7-ad18-b85b6ce7e825 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.745233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e057af-92de-45ad-a5fc-16732f6d4735 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:23.746373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5b557245-1142-44c7-ad18-b85b6ce7e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.756105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e057af-92de-45ad-a5fc-16732f6d4735 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:23.757190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 782/1552] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:23.758302 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8adf-e278-4daa-8e3c-c9c2c47c4d39 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.758586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8adf-e278-4daa-8e3c-c9c2c47c4d39 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.758859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8adf-e278-4daa-8e3c-c9c2c47c4d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.762543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b884d58-22a2-4615-b4ee-b95e2e727ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:23.763404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b884d58-22a2-4615-b4ee-b95e2e727ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.764190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b884d58-22a2-4615-b4ee-b95e2e727ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.764621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b884d58-22a2-4615-b4ee-b95e2e727ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.765506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b884d58-22a2-4615-b4ee-b95e2e727ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:23.767868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b884d58-22a2-4615-b4ee-b95e2e727ec0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:23.780402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-270c8adf-e278-4daa-8e3c-c9c2c47c4d39 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.780402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-270c8adf-e278-4daa-8e3c-c9c2c47c4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.788204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 783/1553] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:23.789751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d3c7b-9f7f-430f-8467-ed845b73f3c2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.790141 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d3c7b-9f7f-430f-8467-ed845b73f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.790373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d3c7b-9f7f-430f-8467-ed845b73f3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.802008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 771/1554] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:23.803662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d689-788b-401c-b98c-eccc85b21fb5 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.804228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d689-788b-401c-b98c-eccc85b21fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.804339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d689-788b-401c-b98c-eccc85b21fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.809047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-238d3c7b-9f7f-430f-8467-ed845b73f3c2 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.810311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-238d3c7b-9f7f-430f-8467-ed845b73f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.822115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8881d689-788b-401c-b98c-eccc85b21fb5 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.823286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8881d689-788b-401c-b98c-eccc85b21fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.871010 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 784/1555] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:23.873495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d3c7b-9f7f-430f-8467-ed845b73f3c2 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:23.883856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d3c7b-9f7f-430f-8467-ed845b73f3c2 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:23.884739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 772/1556] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:23.886171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9bf3-2dd6-4261-b29f-2766b9f699c6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.886493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9bf3-2dd6-4261-b29f-2766b9f699c6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.886777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9bf3-2dd6-4261-b29f-2766b9f699c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.894137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa5450-4a70-4db0-af8c-2417f158165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:23.895033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5450-4a70-4db0-af8c-2417f158165f admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.895316 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5450-4a70-4db0-af8c-2417f158165f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.895592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5450-4a70-4db0-af8c-2417f158165f admin admin] PATH_INFO: `/v3/projects/2dffbe34dfba4632bb43052cba029837/users/0d2f6d94fa39475c9a05723d423fed4b/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.909263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-28fd9bf3-2dd6-4261-b29f-2766b9f699c6 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.910444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-28fd9bf3-2dd6-4261-b29f-2766b9f699c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.911177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa5450-4a70-4db0-af8c-2417f158165f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dffbe34dfba4632bb43052cba029837, user_id=0d2f6d94fa39475c9a05723d423fed4b, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:23.912217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-20fa5450-4a70-4db0-af8c-2417f158165f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:18:23.912217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 14 09:18:23.912217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: Jul 14 09:18:23.914407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa5450-4a70-4db0-af8c-2417f158165f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:23.919412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 773/1557] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:23.921024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b5f2d-87e4-41c6-8c92-e0da87ac9bc7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.921342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b5f2d-87e4-41c6-8c92-e0da87ac9bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.921621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b5f2d-87e4-41c6-8c92-e0da87ac9bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.928351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:23.929716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 785/1558] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:23 2022] PUT /identity/v3/projects/2dffbe34dfba4632bb43052cba029837/users/0d2f6d94fa39475c9a05723d423fed4b/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:23.930962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb8adf-096a-47ec-a96c-00c75bf52b1d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:23.931287 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb8adf-096a-47ec-a96c-00c75bf52b1d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:23.931522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb8adf-096a-47ec-a96c-00c75bf52b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:23.947358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-988b5f2d-87e4-41c6-8c92-e0da87ac9bc7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.948789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-988b5f2d-87e4-41c6-8c92-e0da87ac9bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.950776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0deb8adf-096a-47ec-a96c-00c75bf52b1d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:23.951948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0deb8adf-096a-47ec-a96c-00c75bf52b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:23.957878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:24.016453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 786/1559] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:24.016846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 774/1560] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:24.017668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b5f2d-87e4-41c6-8c92-e0da87ac9bc7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.020867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb8adf-096a-47ec-a96c-00c75bf52b1d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.030464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb8adf-096a-47ec-a96c-00c75bf52b1d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.032975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b5f2d-87e4-41c6-8c92-e0da87ac9bc7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.035247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ead227-ecaa-45b6-9560-fee440296e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.035941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ead227-ecaa-45b6-9560-fee440296e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.036197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ead227-ecaa-45b6-9560-fee440296e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.036479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ead227-ecaa-45b6-9560-fee440296e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.037274 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ead227-ecaa-45b6-9560-fee440296e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:24.037577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ead227-ecaa-45b6-9560-fee440296e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.038989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45d232-4715-4ba4-9291-f7940d75f7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.039229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ead227-ecaa-45b6-9560-fee440296e19 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.039662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45d232-4715-4ba4-9291-f7940d75f7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.039947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45d232-4715-4ba4-9291-f7940d75f7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.040218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45d232-4715-4ba4-9291-f7940d75f7d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.040951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45d232-4715-4ba4-9291-f7940d75f7d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.041931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-ae45d232-4715-4ba4-9291-f7940d75f7d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:18:24.041931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 14 09:18:24.041931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: Jul 14 09:18:24.043143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45d232-4715-4ba4-9291-f7940d75f7d5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.051483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 787/1561] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:24.052689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3943b8f-6dfb-41ab-989f-0fb80ee59cb4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.052999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3943b8f-6dfb-41ab-989f-0fb80ee59cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.053389 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3943b8f-6dfb-41ab-989f-0fb80ee59cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.072175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b3943b8f-6dfb-41ab-989f-0fb80ee59cb4 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:24.073055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 775/1562] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.073396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b3943b8f-6dfb-41ab-989f-0fb80ee59cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:24.074478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b6a0-d549-4cfe-85bb-5b9acb217eea None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.074768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b6a0-d549-4cfe-85bb-5b9acb217eea None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.075208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b6a0-d549-4cfe-85bb-5b9acb217eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.081843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 788/1563] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:24.083673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3943b8f-6dfb-41ab-989f-0fb80ee59cb4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.093077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c446b6a0-d549-4cfe-85bb-5b9acb217eea None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:24.093265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3943b8f-6dfb-41ab-989f-0fb80ee59cb4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.094291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c446b6a0-d549-4cfe-85bb-5b9acb217eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:24.097992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026605c2-538a-4739-b13c-f1ce15b1752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.098651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026605c2-538a-4739-b13c-f1ce15b1752e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.098938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026605c2-538a-4739-b13c-f1ce15b1752e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.099218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026605c2-538a-4739-b13c-f1ce15b1752e admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.099948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026605c2-538a-4739-b13c-f1ce15b1752e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:24.100427 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026605c2-538a-4739-b13c-f1ce15b1752e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.102075 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026605c2-538a-4739-b13c-f1ce15b1752e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.102309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 776/1564] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:24.106478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18881f9-86e0-47b3-ad75-0c8ebb31edd2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.106478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18881f9-86e0-47b3-ad75-0c8ebb31edd2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.106478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18881f9-86e0-47b3-ad75-0c8ebb31edd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.117926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 789/1565] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:24.125322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026605c2-538a-4739-b13c-f1ce15b1752e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.129555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026605c2-538a-4739-b13c-f1ce15b1752e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.131157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d18881f9-86e0-47b3-ad75-0c8ebb31edd2 None None] MFA Rules not processed for user `0d2f6d94fa39475c9a05723d423fed4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:24.132441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d18881f9-86e0-47b3-ad75-0c8ebb31edd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:24.134509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82f2cf-d941-4d29-9e3b-dd344d5cfe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.135301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f2cf-d941-4d29-9e3b-dd344d5cfe3e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.135590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f2cf-d941-4d29-9e3b-dd344d5cfe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.135977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f2cf-d941-4d29-9e3b-dd344d5cfe3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.136734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f2cf-d941-4d29-9e3b-dd344d5cfe3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:24.137043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f2cf-d941-4d29-9e3b-dd344d5cfe3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.138959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f2cf-d941-4d29-9e3b-dd344d5cfe3e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.151852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 790/1566] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:24.153183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f657-3fcb-4469-97ec-0d20bcb8e686 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.153473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f657-3fcb-4469-97ec-0d20bcb8e686 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.153783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f657-3fcb-4469-97ec-0d20bcb8e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.172555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e8d7f657-3fcb-4469-97ec-0d20bcb8e686 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:24.173764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e8d7f657-3fcb-4469-97ec-0d20bcb8e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:24.183309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 791/1567] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:24.183822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7f657-3fcb-4469-97ec-0d20bcb8e686 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.193659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7f657-3fcb-4469-97ec-0d20bcb8e686 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.199005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7cd31-d890-4b6f-9640-66f66a5c9bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.199656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7cd31-d890-4b6f-9640-66f66a5c9bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.200059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7cd31-d890-4b6f-9640-66f66a5c9bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.200343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7cd31-d890-4b6f-9640-66f66a5c9bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.201058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7cd31-d890-4b6f-9640-66f66a5c9bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.202078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-74f7cd31-d890-4b6f-9640-66f66a5c9bf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:18:24.202078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 14 09:18:24.202078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: Jul 14 09:18:24.203308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7cd31-d890-4b6f-9640-66f66a5c9bf2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.212803 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 777/1568] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:24.213779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18881f9-86e0-47b3-ad75-0c8ebb31edd2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.225307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18881f9-86e0-47b3-ad75-0c8ebb31edd2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.230645 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa669fb-430d-450b-a919-305a636baa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.231319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa669fb-430d-450b-a919-305a636baa23 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.231731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa669fb-430d-450b-a919-305a636baa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.232013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa669fb-430d-450b-a919-305a636baa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.232779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa669fb-430d-450b-a919-305a636baa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.234448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa669fb-430d-450b-a919-305a636baa23 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.239096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 792/1569] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.239096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7cd31-d890-4b6f-9640-66f66a5c9bf2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.248444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 778/1570] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:24.248444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa669fb-430d-450b-a919-305a636baa23 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.256147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa669fb-430d-450b-a919-305a636baa23 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.302713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7cd31-d890-4b6f-9640-66f66a5c9bf2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.306338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:24.308337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59db63-46de-46ce-9523-3aaddb4b1d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.309339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59db63-46de-46ce-9523-3aaddb4b1d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.309594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59db63-46de-46ce-9523-3aaddb4b1d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.309869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59db63-46de-46ce-9523-3aaddb4b1d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.310619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59db63-46de-46ce-9523-3aaddb4b1d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:24.310923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59db63-46de-46ce-9523-3aaddb4b1d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.312725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59db63-46de-46ce-9523-3aaddb4b1d36 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.313793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a589c-b356-4666-9492-26601ea46e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.314468 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a589c-b356-4666-9492-26601ea46e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.314989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a589c-b356-4666-9492-26601ea46e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.315885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a589c-b356-4666-9492-26601ea46e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.316609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a589c-b356-4666-9492-26601ea46e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:24.316963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a589c-b356-4666-9492-26601ea46e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.318541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a589c-b356-4666-9492-26601ea46e03 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.325049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 793/1571] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:24.325627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59db63-46de-46ce-9523-3aaddb4b1d36 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.335512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59db63-46de-46ce-9523-3aaddb4b1d36 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.337782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 779/1572] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:24.338611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a589c-b356-4666-9492-26601ea46e03 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.340533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ee00b-5e88-4a47-a5cd-efde4d5f8035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.341323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ee00b-5e88-4a47-a5cd-efde4d5f8035 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.341699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ee00b-5e88-4a47-a5cd-efde4d5f8035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.342286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ee00b-5e88-4a47-a5cd-efde4d5f8035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.343055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ee00b-5e88-4a47-a5cd-efde4d5f8035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.345183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ee00b-5e88-4a47-a5cd-efde4d5f8035 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.349732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a589c-b356-4666-9492-26601ea46e03 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.354531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd52c9b-e036-42ef-a901-6246201a8fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.355205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd52c9b-e036-42ef-a901-6246201a8fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.355485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd52c9b-e036-42ef-a901-6246201a8fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.355729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd52c9b-e036-42ef-a901-6246201a8fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.356441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd52c9b-e036-42ef-a901-6246201a8fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.358357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd52c9b-e036-42ef-a901-6246201a8fb2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.378755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 794/1573] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.379616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ee00b-5e88-4a47-a5cd-efde4d5f8035 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.394682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:24.400252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 780/1574] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.400252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd52c9b-e036-42ef-a901-6246201a8fb2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.451847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ee00b-5e88-4a47-a5cd-efde4d5f8035 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.461683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd52c9b-e036-42ef-a901-6246201a8fb2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.466373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd6c95-555b-4bad-889f-9450f21d959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.467030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd6c95-555b-4bad-889f-9450f21d959c admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.467310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd6c95-555b-4bad-889f-9450f21d959c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.467580 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd6c95-555b-4bad-889f-9450f21d959c admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.468273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd6c95-555b-4bad-889f-9450f21d959c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.470208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd6c95-555b-4bad-889f-9450f21d959c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.496381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 781/1575] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/projects => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.500684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd6c95-555b-4bad-889f-9450f21d959c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.513172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6357d5-3c99-4763-9af5-2386bcdeb0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.514161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6357d5-3c99-4763-9af5-2386bcdeb0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.514442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6357d5-3c99-4763-9af5-2386bcdeb0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.514712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6357d5-3c99-4763-9af5-2386bcdeb0ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.515431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6357d5-3c99-4763-9af5-2386bcdeb0ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:24.515732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6357d5-3c99-4763-9af5-2386bcdeb0ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.517366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6357d5-3c99-4763-9af5-2386bcdeb0ff admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.529502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 795/1576] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:24.530321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6357d5-3c99-4763-9af5-2386bcdeb0ff admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.543183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6357d5-3c99-4763-9af5-2386bcdeb0ff admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.571449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd6c95-555b-4bad-889f-9450f21d959c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.576289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce37017-7409-48a1-83c8-3f3575f7a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.576995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37017-7409-48a1-83c8-3f3575f7a7bd admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.577278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37017-7409-48a1-83c8-3f3575f7a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.577588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37017-7409-48a1-83c8-3f3575f7a7bd admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.578270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce37017-7409-48a1-83c8-3f3575f7a7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.580190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce37017-7409-48a1-83c8-3f3575f7a7bd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.604522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 782/1577] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.604522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce37017-7409-48a1-83c8-3f3575f7a7bd admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.607501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37ca6-79d9-434a-8820-2635117a659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.608199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37ca6-79d9-434a-8820-2635117a659d admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.609309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37ca6-79d9-434a-8820-2635117a659d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.609601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37ca6-79d9-434a-8820-2635117a659d admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.610349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a37ca6-79d9-434a-8820-2635117a659d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.611937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a37ca6-79d9-434a-8820-2635117a659d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.612461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce37017-7409-48a1-83c8-3f3575f7a7bd admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.617291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b95d9-9d8d-483f-bc9e-c726bd857bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.617947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b95d9-9d8d-483f-bc9e-c726bd857bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.618234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b95d9-9d8d-483f-bc9e-c726bd857bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.618512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b95d9-9d8d-483f-bc9e-c726bd857bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.619205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b95d9-9d8d-483f-bc9e-c726bd857bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.621138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b95d9-9d8d-483f-bc9e-c726bd857bbc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.622599 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 796/1578] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:24.623453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37ca6-79d9-434a-8820-2635117a659d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.633579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37ca6-79d9-434a-8820-2635117a659d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.639274 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03415e-4f8d-4fa5-a7ac-e67f94fbe8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.639942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03415e-4f8d-4fa5-a7ac-e67f94fbe8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.640266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03415e-4f8d-4fa5-a7ac-e67f94fbe8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.640541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03415e-4f8d-4fa5-a7ac-e67f94fbe8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.641267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03415e-4f8d-4fa5-a7ac-e67f94fbe8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.643329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03415e-4f8d-4fa5-a7ac-e67f94fbe8d7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.650034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 783/1579] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.651159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b95d9-9d8d-483f-bc9e-c726bd857bbc admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.673325 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 797/1580] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.674437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03415e-4f8d-4fa5-a7ac-e67f94fbe8d7 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.681582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:24.704011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:24.720585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b95d9-9d8d-483f-bc9e-c726bd857bbc admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.739400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03415e-4f8d-4fa5-a7ac-e67f94fbe8d7 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.744197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35255e08-826b-438f-85e6-7a65ed1a787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.744910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255e08-826b-438f-85e6-7a65ed1a787d admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.745221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255e08-826b-438f-85e6-7a65ed1a787d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.745499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255e08-826b-438f-85e6-7a65ed1a787d admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.746192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35255e08-826b-438f-85e6-7a65ed1a787d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.748146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35255e08-826b-438f-85e6-7a65ed1a787d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.769455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 798/1581] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.770257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35255e08-826b-438f-85e6-7a65ed1a787d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.780335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35255e08-826b-438f-85e6-7a65ed1a787d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.781439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77104fc-f72e-4486-b4f1-cf9d23741bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.782165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77104fc-f72e-4486-b4f1-cf9d23741bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.782442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77104fc-f72e-4486-b4f1-cf9d23741bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.782723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77104fc-f72e-4486-b4f1-cf9d23741bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.783405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77104fc-f72e-4486-b4f1-cf9d23741bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.785384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77104fc-f72e-4486-b4f1-cf9d23741bc4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.785532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d8876-ba21-44bb-8fe9-912495c382f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.786127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d8876-ba21-44bb-8fe9-912495c382f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.786414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d8876-ba21-44bb-8fe9-912495c382f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.786695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d8876-ba21-44bb-8fe9-912495c382f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.787409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d8876-ba21-44bb-8fe9-912495c382f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.789602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d8876-ba21-44bb-8fe9-912495c382f1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.809037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 784/1582] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.809037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77104fc-f72e-4486-b4f1-cf9d23741bc4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.812037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 799/1583] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.812037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d8876-ba21-44bb-8fe9-912495c382f1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.817960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77104fc-f72e-4486-b4f1-cf9d23741bc4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.820631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d8876-ba21-44bb-8fe9-912495c382f1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.823103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504af0f0-f6e1-45f5-83c2-734da0d514db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.823843 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504af0f0-f6e1-45f5-83c2-734da0d514db admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.824132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504af0f0-f6e1-45f5-83c2-734da0d514db admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.824413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504af0f0-f6e1-45f5-83c2-734da0d514db admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.825156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504af0f0-f6e1-45f5-83c2-734da0d514db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.826142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac365f-4567-4101-a1a2-e8dea1fa51e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.826802 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac365f-4567-4101-a1a2-e8dea1fa51e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.827074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504af0f0-f6e1-45f5-83c2-734da0d514db admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.827187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac365f-4567-4101-a1a2-e8dea1fa51e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.827347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac365f-4567-4101-a1a2-e8dea1fa51e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.828073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac365f-4567-4101-a1a2-e8dea1fa51e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.829698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac365f-4567-4101-a1a2-e8dea1fa51e3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.840326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 800/1584] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:24.841090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac365f-4567-4101-a1a2-e8dea1fa51e3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.851632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac365f-4567-4101-a1a2-e8dea1fa51e3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.856645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f742e-7bdf-4d5d-abe6-f93453d0a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.857585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f742e-7bdf-4d5d-abe6-f93453d0a3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.857862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f742e-7bdf-4d5d-abe6-f93453d0a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.858134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f742e-7bdf-4d5d-abe6-f93453d0a3f0 admin admin] PATH_INFO: `/v3/projects/f60cd246d561476bbdd6eb5372df7f4f/users/f354a75ed51144769da1db0ec92e7980/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.858849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 785/1585] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.859710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504af0f0-f6e1-45f5-83c2-734da0d514db admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.877240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f742e-7bdf-4d5d-abe6-f93453d0a3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60cd246d561476bbdd6eb5372df7f4f, user_id=f354a75ed51144769da1db0ec92e7980, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.879899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f742e-7bdf-4d5d-abe6-f93453d0a3f0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.895252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 801/1586] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:24 2022] PUT /identity/v3/projects/f60cd246d561476bbdd6eb5372df7f4f/users/f354a75ed51144769da1db0ec92e7980/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:24.896040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f742e-7bdf-4d5d-abe6-f93453d0a3f0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:24.926991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504af0f0-f6e1-45f5-83c2-734da0d514db admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.963101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f742e-7bdf-4d5d-abe6-f93453d0a3f0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:24.968800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e2f92-59d3-487c-ac97-552fe7389ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.969539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e2f92-59d3-487c-ac97-552fe7389ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.969822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e2f92-59d3-487c-ac97-552fe7389ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.970101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e2f92-59d3-487c-ac97-552fe7389ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.970827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e2f92-59d3-487c-ac97-552fe7389ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.972804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e2f92-59d3-487c-ac97-552fe7389ed4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.973206 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:24.992209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328bdb3-a3d9-4137-8f81-7f9752658611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:24.992918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328bdb3-a3d9-4137-8f81-7f9752658611 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:24.993197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328bdb3-a3d9-4137-8f81-7f9752658611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:24.993470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328bdb3-a3d9-4137-8f81-7f9752658611 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:24.994159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328bdb3-a3d9-4137-8f81-7f9752658611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:24.995134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 802/1587] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:24.998541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328bdb3-a3d9-4137-8f81-7f9752658611 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:24.998699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e2f92-59d3-487c-ac97-552fe7389ed4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.009638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e2f92-59d3-487c-ac97-552fe7389ed4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.014666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3fd08-63ce-4566-b582-f2627347012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.015337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3fd08-63ce-4566-b582-f2627347012d admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.015629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3fd08-63ce-4566-b582-f2627347012d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.015906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3fd08-63ce-4566-b582-f2627347012d admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.016675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3fd08-63ce-4566-b582-f2627347012d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.018307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3fd08-63ce-4566-b582-f2627347012d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.019611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 786/1588] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:24 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:25.023298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328bdb3-a3d9-4137-8f81-7f9752658611 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.029440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 803/1589] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.030430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3fd08-63ce-4566-b582-f2627347012d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.034482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328bdb3-a3d9-4137-8f81-7f9752658611 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.039142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d7ca1-855a-4051-be37-e9560a7f1a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.039855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d7ca1-855a-4051-be37-e9560a7f1a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.040142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d7ca1-855a-4051-be37-e9560a7f1a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.040421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d7ca1-855a-4051-be37-e9560a7f1a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.041190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d7ca1-855a-4051-be37-e9560a7f1a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.041294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3fd08-63ce-4566-b582-f2627347012d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.042903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d7ca1-855a-4051-be37-e9560a7f1a9a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.046124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7f447-05c4-4024-a4f8-8fb2488b0dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.046859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7f447-05c4-4024-a4f8-8fb2488b0dfc admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.047139 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7f447-05c4-4024-a4f8-8fb2488b0dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.047409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7f447-05c4-4024-a4f8-8fb2488b0dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.048126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7f447-05c4-4024-a4f8-8fb2488b0dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.049884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7f447-05c4-4024-a4f8-8fb2488b0dfc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.053627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 787/1590] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.054577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d7ca1-855a-4051-be37-e9560a7f1a9a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.064694 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 804/1591] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.064879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7f447-05c4-4024-a4f8-8fb2488b0dfc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.070983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d7ca1-855a-4051-be37-e9560a7f1a9a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.074364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7f447-05c4-4024-a4f8-8fb2488b0dfc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.075716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b362f3-8033-4a57-bc10-67f0133e9cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.076389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b362f3-8033-4a57-bc10-67f0133e9cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.076686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b362f3-8033-4a57-bc10-67f0133e9cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.076976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b362f3-8033-4a57-bc10-67f0133e9cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.077711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b362f3-8033-4a57-bc10-67f0133e9cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.078737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e313f1-e494-4da0-a49f-c6626b56db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.079316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b362f3-8033-4a57-bc10-67f0133e9cf3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.079444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e313f1-e494-4da0-a49f-c6626b56db55 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.079653 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e313f1-e494-4da0-a49f-c6626b56db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.079925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e313f1-e494-4da0-a49f-c6626b56db55 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.080627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e313f1-e494-4da0-a49f-c6626b56db55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.082520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e313f1-e494-4da0-a49f-c6626b56db55 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.090655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 788/1592] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.092013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420cc62-f032-4280-8175-e35c204c004c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.092245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420cc62-f032-4280-8175-e35c204c004c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.092522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420cc62-f032-4280-8175-e35c204c004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.108175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 805/1593] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:25 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:25.108175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e313f1-e494-4da0-a49f-c6626b56db55 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.113919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5420cc62-f032-4280-8175-e35c204c004c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:25.115111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5420cc62-f032-4280-8175-e35c204c004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:25.115985 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e313f1-e494-4da0-a49f-c6626b56db55 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.120471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ffd1b-9be8-45de-81c9-b3f104c0577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.121357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ffd1b-9be8-45de-81c9-b3f104c0577b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.121638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ffd1b-9be8-45de-81c9-b3f104c0577b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.121909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ffd1b-9be8-45de-81c9-b3f104c0577b admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.122627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ffd1b-9be8-45de-81c9-b3f104c0577b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.122760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 789/1594] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:25.125900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420cc62-f032-4280-8175-e35c204c004c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.126045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ffd1b-9be8-45de-81c9-b3f104c0577b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.132219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:25.137380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420cc62-f032-4280-8175-e35c204c004c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.139275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 806/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.139916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ffd1b-9be8-45de-81c9-b3f104c0577b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.142761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19444d94-28d2-4b97-82bd-069ce5ea4288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.143541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444d94-28d2-4b97-82bd-069ce5ea4288 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.143958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444d94-28d2-4b97-82bd-069ce5ea4288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.144243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444d94-28d2-4b97-82bd-069ce5ea4288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.145021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19444d94-28d2-4b97-82bd-069ce5ea4288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.146625 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19444d94-28d2-4b97-82bd-069ce5ea4288 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.151126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ffd1b-9be8-45de-81c9-b3f104c0577b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.156161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9d88f-7083-42bc-9bc1-3b094bdb67bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.156846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9d88f-7083-42bc-9bc1-3b094bdb67bc admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.157096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 790/1596] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.160275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9d88f-7083-42bc-9bc1-3b094bdb67bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.160275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9d88f-7083-42bc-9bc1-3b094bdb67bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.160459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19444d94-28d2-4b97-82bd-069ce5ea4288 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.160553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9d88f-7083-42bc-9bc1-3b094bdb67bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.160553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9d88f-7083-42bc-9bc1-3b094bdb67bc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.170350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 807/1597] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.170516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19444d94-28d2-4b97-82bd-069ce5ea4288 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.171183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9d88f-7083-42bc-9bc1-3b094bdb67bc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.175332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd51aba-8179-4918-8f91-4c6823f1f690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.176073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd51aba-8179-4918-8f91-4c6823f1f690 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.176432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd51aba-8179-4918-8f91-4c6823f1f690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.176805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd51aba-8179-4918-8f91-4c6823f1f690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.177604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd51aba-8179-4918-8f91-4c6823f1f690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.179374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd51aba-8179-4918-8f91-4c6823f1f690 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.181373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9d88f-7083-42bc-9bc1-3b094bdb67bc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.185890 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d7c1e-ac97-4fd9-9134-a1ed90c4fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.186766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d7c1e-ac97-4fd9-9134-a1ed90c4fcd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.187042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d7c1e-ac97-4fd9-9134-a1ed90c4fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.187312 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d7c1e-ac97-4fd9-9134-a1ed90c4fcd5 admin admin] PATH_INFO: `/v3/projects/0e19010f4ca549d78a670b3f428733fc/users/6a307ce43e1240f2a141e1cf4315f19c/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.190650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 791/1598] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.193810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd51aba-8179-4918-8f91-4c6823f1f690 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.201107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd51aba-8179-4918-8f91-4c6823f1f690 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.203037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d7c1e-ac97-4fd9-9134-a1ed90c4fcd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e19010f4ca549d78a670b3f428733fc, user_id=6a307ce43e1240f2a141e1cf4315f19c, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.205709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d7c1e-ac97-4fd9-9134-a1ed90c4fcd5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.205879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f111e8-2cba-439c-a794-04ce3ed48580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.206725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f111e8-2cba-439c-a794-04ce3ed48580 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.207007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f111e8-2cba-439c-a794-04ce3ed48580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.207280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f111e8-2cba-439c-a794-04ce3ed48580 admin admin] PATH_INFO: `/v3/projects/1858d275ca114dd0949fa9e454c1f958/users/79ac3d72bfd44bb6a79fd37466aa8092/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.220894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 808/1599] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:25 2022] PUT /identity/v3/projects/0e19010f4ca549d78a670b3f428733fc/users/6a307ce43e1240f2a141e1cf4315f19c/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:25.221981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d7c1e-ac97-4fd9-9134-a1ed90c4fcd5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.226128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f111e8-2cba-439c-a794-04ce3ed48580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1858d275ca114dd0949fa9e454c1f958, user_id=79ac3d72bfd44bb6a79fd37466aa8092, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.229103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f111e8-2cba-439c-a794-04ce3ed48580 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.243404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 792/1600] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:25 2022] PUT /identity/v3/projects/1858d275ca114dd0949fa9e454c1f958/users/79ac3d72bfd44bb6a79fd37466aa8092/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:25.244793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f111e8-2cba-439c-a794-04ce3ed48580 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.246443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c6f111e8-2cba-439c-a794-04ce3ed48580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:25.289500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d7c1e-ac97-4fd9-9134-a1ed90c4fcd5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.311390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f111e8-2cba-439c-a794-04ce3ed48580 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.315250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412b3d-040c-43c3-9f60-1493bf0092d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.315914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412b3d-040c-43c3-9f60-1493bf0092d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.316199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412b3d-040c-43c3-9f60-1493bf0092d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.316473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412b3d-040c-43c3-9f60-1493bf0092d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.349949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03ed8c-5b07-47b2-9655-003a817c2516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.350746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03ed8c-5b07-47b2-9655-003a817c2516 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.351198 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03ed8c-5b07-47b2-9655-003a817c2516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.351482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03ed8c-5b07-47b2-9655-003a817c2516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.352208 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03ed8c-5b07-47b2-9655-003a817c2516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.353873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03ed8c-5b07-47b2-9655-003a817c2516 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.371681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 809/1601] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.372609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03ed8c-5b07-47b2-9655-003a817c2516 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.382635 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03ed8c-5b07-47b2-9655-003a817c2516 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.387238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccba30d-4a3d-4df4-ab77-356fcfcdf336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.387397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00412b3d-040c-43c3-9f60-1493bf0092d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.387904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba30d-4a3d-4df4-ab77-356fcfcdf336 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.388184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba30d-4a3d-4df4-ab77-356fcfcdf336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.388458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba30d-4a3d-4df4-ab77-356fcfcdf336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.389206 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00412b3d-040c-43c3-9f60-1493bf0092d3 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.389526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccba30d-4a3d-4df4-ab77-356fcfcdf336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.391113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccba30d-4a3d-4df4-ab77-356fcfcdf336 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.399766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 793/1602] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:25.400601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412b3d-040c-43c3-9f60-1493bf0092d3 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.401769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 810/1603] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.405895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccba30d-4a3d-4df4-ab77-356fcfcdf336 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.413195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412b3d-040c-43c3-9f60-1493bf0092d3 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.416271 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccba30d-4a3d-4df4-ab77-356fcfcdf336 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.420157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456eb78-5b4e-451c-94f5-7d912ce6b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.421134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456eb78-5b4e-451c-94f5-7d912ce6b3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.421427 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456eb78-5b4e-451c-94f5-7d912ce6b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.421715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456eb78-5b4e-451c-94f5-7d912ce6b3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.422052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9533078-a93f-4428-9ac9-bacfb0acf9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.422429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456eb78-5b4e-451c-94f5-7d912ce6b3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.423038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533078-a93f-4428-9ac9-bacfb0acf9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.423321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533078-a93f-4428-9ac9-bacfb0acf9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.423685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533078-a93f-4428-9ac9-bacfb0acf9d2 admin admin] PATH_INFO: `/v3/projects/2edb319adbd74bb7931173d4f46a67df/users/d2b2f1b8064945e4834be2050db26867/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.424351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456eb78-5b4e-451c-94f5-7d912ce6b3b7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.428711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:25.441403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 794/1604] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.442351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456eb78-5b4e-451c-94f5-7d912ce6b3b7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.444491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9533078-a93f-4428-9ac9-bacfb0acf9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edb319adbd74bb7931173d4f46a67df, user_id=d2b2f1b8064945e4834be2050db26867, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.448073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9533078-a93f-4428-9ac9-bacfb0acf9d2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.453985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456eb78-5b4e-451c-94f5-7d912ce6b3b7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.459114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc84eaf-93fb-4e12-851a-805f90b4af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.460124 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc84eaf-93fb-4e12-851a-805f90b4af09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.460704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc84eaf-93fb-4e12-851a-805f90b4af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.461060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc84eaf-93fb-4e12-851a-805f90b4af09 admin admin] PATH_INFO: `/v3/projects/bab125ba76b240c5ad1aff3a185c609e/users/b458732ea150427f98eded06b87a8f33/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.467826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 811/1605] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:25 2022] PUT /identity/v3/projects/2edb319adbd74bb7931173d4f46a67df/users/d2b2f1b8064945e4834be2050db26867/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:25.467826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9533078-a93f-4428-9ac9-bacfb0acf9d2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.482485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc84eaf-93fb-4e12-851a-805f90b4af09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab125ba76b240c5ad1aff3a185c609e, user_id=b458732ea150427f98eded06b87a8f33, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.485247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc84eaf-93fb-4e12-851a-805f90b4af09 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.500202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 795/1606] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:25 2022] PUT /identity/v3/projects/bab125ba76b240c5ad1aff3a185c609e/users/b458732ea150427f98eded06b87a8f33/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:25.501474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7bea1-d95a-403b-8a19-8c2cfd0f331a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.501763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7bea1-d95a-403b-8a19-8c2cfd0f331a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.502220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7bea1-d95a-403b-8a19-8c2cfd0f331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.520796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7af7bea1-d95a-403b-8a19-8c2cfd0f331a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:25.522236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7af7bea1-d95a-403b-8a19-8c2cfd0f331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:25.523609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:25.558731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9533078-a93f-4428-9ac9-bacfb0acf9d2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.608048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 796/1607] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:25.612108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7bea1-d95a-403b-8a19-8c2cfd0f331a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.622024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7bea1-d95a-403b-8a19-8c2cfd0f331a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.627706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91569-6a90-45e8-8ba3-ed92d242950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.628411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91569-6a90-45e8-8ba3-ed92d242950c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.628721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91569-6a90-45e8-8ba3-ed92d242950c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.628995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91569-6a90-45e8-8ba3-ed92d242950c admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.629726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd91569-6a90-45e8-8ba3-ed92d242950c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.631367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd91569-6a90-45e8-8ba3-ed92d242950c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.644430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 797/1608] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.645152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91569-6a90-45e8-8ba3-ed92d242950c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.652920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e99da-d8dd-4858-88de-fb236ab585f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.653543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e99da-d8dd-4858-88de-fb236ab585f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.654063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e99da-d8dd-4858-88de-fb236ab585f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.654239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e99da-d8dd-4858-88de-fb236ab585f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.654998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e99da-d8dd-4858-88de-fb236ab585f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.656569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91569-6a90-45e8-8ba3-ed92d242950c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.656722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e99da-d8dd-4858-88de-fb236ab585f5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.662151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed18e3-67cf-4b16-8fba-4536728752fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.663229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed18e3-67cf-4b16-8fba-4536728752fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.663542 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed18e3-67cf-4b16-8fba-4536728752fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.664010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed18e3-67cf-4b16-8fba-4536728752fe admin admin] PATH_INFO: `/v3/projects/8bf21f429b6148bcb4ab6f273b31b24a/users/0bea4c8d195145a29eefee98e4b9ef4c/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.668132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 812/1609] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:25.668984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e99da-d8dd-4858-88de-fb236ab585f5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.680598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed18e3-67cf-4b16-8fba-4536728752fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf21f429b6148bcb4ab6f273b31b24a, user_id=0bea4c8d195145a29eefee98e4b9ef4c, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.681817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e99da-d8dd-4858-88de-fb236ab585f5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.683380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed18e3-67cf-4b16-8fba-4536728752fe admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.688685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440a8c9-d8b0-462a-be03-1b1f7538d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.689704 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440a8c9-d8b0-462a-be03-1b1f7538d8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.690064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440a8c9-d8b0-462a-be03-1b1f7538d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.690348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440a8c9-d8b0-462a-be03-1b1f7538d8b5 admin admin] PATH_INFO: `/v3/projects/60f3a08976a74a8eb6e43aba30d38d36/users/2f14b049beea4485a52ca3956b1f5063/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.697773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 798/1610] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:25 2022] PUT /identity/v3/projects/8bf21f429b6148bcb4ab6f273b31b24a/users/0bea4c8d195145a29eefee98e4b9ef4c/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:25.702712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd24a-b8ff-4a38-9a91-7a7b7b7553e7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.703094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd24a-b8ff-4a38-9a91-7a7b7b7553e7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.703445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd24a-b8ff-4a38-9a91-7a7b7b7553e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.708597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440a8c9-d8b0-462a-be03-1b1f7538d8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f3a08976a74a8eb6e43aba30d38d36, user_id=2f14b049beea4485a52ca3956b1f5063, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.711452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440a8c9-d8b0-462a-be03-1b1f7538d8b5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.723906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e64dd24a-b8ff-4a38-9a91-7a7b7b7553e7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:25.725411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e64dd24a-b8ff-4a38-9a91-7a7b7b7553e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:25.727945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 813/1611] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:25 2022] PUT /identity/v3/projects/60f3a08976a74a8eb6e43aba30d38d36/users/2f14b049beea4485a52ca3956b1f5063/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:25.734681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d62eb-2115-4bb0-8ea7-1ac9e99ce18e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.735154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d62eb-2115-4bb0-8ea7-1ac9e99ce18e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.736416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d62eb-2115-4bb0-8ea7-1ac9e99ce18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.782922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c17d62eb-2115-4bb0-8ea7-1ac9e99ce18e None None] MFA Rules not processed for user `b458732ea150427f98eded06b87a8f33`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:25.784499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c17d62eb-2115-4bb0-8ea7-1ac9e99ce18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:25.804813 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 799/1612] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:25.808932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dd24a-b8ff-4a38-9a91-7a7b7b7553e7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.864843 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:25.881069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dd24a-b8ff-4a38-9a91-7a7b7b7553e7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.889123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 814/1613] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:25.889123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d62eb-2115-4bb0-8ea7-1ac9e99ce18e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.896501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4f274-2846-422d-8990-cf46e97d01a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.897839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4f274-2846-422d-8990-cf46e97d01a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.897839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4f274-2846-422d-8990-cf46e97d01a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.898112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4f274-2846-422d-8990-cf46e97d01a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.903240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d62eb-2115-4bb0-8ea7-1ac9e99ce18e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.909350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24141a-5a90-4bc9-b5c4-d880bd2cad3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:25.910259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24141a-5a90-4bc9-b5c4-d880bd2cad3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.910550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24141a-5a90-4bc9-b5c4-d880bd2cad3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.910808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24141a-5a90-4bc9-b5c4-d880bd2cad3c admin admin] PATH_INFO: `/v3/projects/82bcb314827f4140b7012ec880d20e3a/users/090b5fdbe72e403db95a2e8dacbef7e5/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.920914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4f274-2846-422d-8990-cf46e97d01a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.922393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4f274-2846-422d-8990-cf46e97d01a7 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.929920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24141a-5a90-4bc9-b5c4-d880bd2cad3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bcb314827f4140b7012ec880d20e3a, user_id=090b5fdbe72e403db95a2e8dacbef7e5, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:25.933016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24141a-5a90-4bc9-b5c4-d880bd2cad3c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:25.933956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 800/1614] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:25.935164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4f274-2846-422d-8990-cf46e97d01a7 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:25.946302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4f274-2846-422d-8990-cf46e97d01a7 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:25.951376 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 815/1615] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:25 2022] PUT /identity/v3/projects/82bcb314827f4140b7012ec880d20e3a/users/090b5fdbe72e403db95a2e8dacbef7e5/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:25.953004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657907b-0882-4ad7-a942-1913cdc8bf10 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:25.953317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657907b-0882-4ad7-a942-1913cdc8bf10 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:25.953581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657907b-0882-4ad7-a942-1913cdc8bf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:25.972481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d657907b-0882-4ad7-a942-1913cdc8bf10 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:25.973777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d657907b-0882-4ad7-a942-1913cdc8bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:25.988975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:26.011749 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7182da-666a-4464-8fa1-f9d552b6ed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:26.012693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7182da-666a-4464-8fa1-f9d552b6ed75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.013099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7182da-666a-4464-8fa1-f9d552b6ed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.013376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7182da-666a-4464-8fa1-f9d552b6ed75 admin admin] PATH_INFO: `/v3/projects/0e19010f4ca549d78a670b3f428733fc/users/6a307ce43e1240f2a141e1cf4315f19c/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.015969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7182da-666a-4464-8fa1-f9d552b6ed75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e19010f4ca549d78a670b3f428733fc, user_id=6a307ce43e1240f2a141e1cf4315f19c, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:26.018766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7182da-666a-4464-8fa1-f9d552b6ed75 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:26.031639 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 801/1616] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:25 2022] PUT /identity/v3/projects/0e19010f4ca549d78a670b3f428733fc/users/6a307ce43e1240f2a141e1cf4315f19c/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:26.031639 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7fd90-8176-4c5a-9ec3-995c26852c65 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.031639 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7fd90-8176-4c5a-9ec3-995c26852c65 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.031639 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7fd90-8176-4c5a-9ec3-995c26852c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.045002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 816/1617] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:26.046234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657907b-0882-4ad7-a942-1913cdc8bf10 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:26.067960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-46e7fd90-8176-4c5a-9ec3-995c26852c65 None None] MFA Rules not processed for user `2f14b049beea4485a52ca3956b1f5063`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:26.069271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-46e7fd90-8176-4c5a-9ec3-995c26852c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:26.107103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657907b-0882-4ad7-a942-1913cdc8bf10 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:26.155376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 802/1618] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:26.161906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1729cf-812d-4f4d-a8e9-6ddc7c5d20d6 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.162276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1729cf-812d-4f4d-a8e9-6ddc7c5d20d6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.163055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1729cf-812d-4f4d-a8e9-6ddc7c5d20d6 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.165621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 803/1619] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jul 14 09:18:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:18:26.167126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b955e2b-2e53-4c45-9132-6b618783e306 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.167554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b955e2b-2e53-4c45-9132-6b618783e306 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.167942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b955e2b-2e53-4c45-9132-6b618783e306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.181969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37420-3b67-4cc0-92c1-eb5d4352fdf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:26.182648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37420-3b67-4cc0-92c1-eb5d4352fdf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.182930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37420-3b67-4cc0-92c1-eb5d4352fdf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.183737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37420-3b67-4cc0-92c1-eb5d4352fdf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.190515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6b955e2b-2e53-4c45-9132-6b618783e306 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:26.192043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6b955e2b-2e53-4c45-9132-6b618783e306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:26.259915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a37420-3b67-4cc0-92c1-eb5d4352fdf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:26.261528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a37420-3b67-4cc0-92c1-eb5d4352fdf3 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:26.275543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 817/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:26.277070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6a2a3-5342-46e5-aeb2-2cf47a9b570a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.277362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6a2a3-5342-46e5-aeb2-2cf47a9b570a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.277777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6a2a3-5342-46e5-aeb2-2cf47a9b570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.282296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 804/1621] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:26.285769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b955e2b-2e53-4c45-9132-6b618783e306 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:26.295233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b955e2b-2e53-4c45-9132-6b618783e306 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:26.299300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2faf5-5be3-4231-8dea-69989a7f8e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:26.301374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2faf5-5be3-4231-8dea-69989a7f8e9f service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.301670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2faf5-5be3-4231-8dea-69989a7f8e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.301954 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2faf5-5be3-4231-8dea-69989a7f8e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.310048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:26.314844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2faf5-5be3-4231-8dea-69989a7f8e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:26.316331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2faf5-5be3-4231-8dea-69989a7f8e9f service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:26.318590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-34d6a2a3-5342-46e5-aeb2-2cf47a9b570a None None] MFA Rules not processed for user `6a307ce43e1240f2a141e1cf4315f19c`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:26.321812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-34d6a2a3-5342-46e5-aeb2-2cf47a9b570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:26.336483 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 805/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:26.341435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df21d-7e27-4c27-9b1e-7fc5e809d932 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.342135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df21d-7e27-4c27-9b1e-7fc5e809d932 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.342426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df21d-7e27-4c27-9b1e-7fc5e809d932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.346386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:26.443217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-462df21d-7e27-4c27-9b1e-7fc5e809d932 None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:26.444797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-462df21d-7e27-4c27-9b1e-7fc5e809d932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:26.468585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 818/1623] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:26 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:26.475316 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890f5a-f438-486c-9627-abfc57a4d219 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.475534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890f5a-f438-486c-9627-abfc57a4d219 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.475876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890f5a-f438-486c-9627-abfc57a4d219 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.477500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 819/1624] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jul 14 09:18:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:18:26.478248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c890f5a-f438-486c-9627-abfc57a4d219 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:26.491088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c890f5a-f438-486c-9627-abfc57a4d219 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:26.495545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b2bf9-a15d-49e4-975c-bd6c89995ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:26.496206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2bf9-a15d-49e4-975c-bd6c89995ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.496490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2bf9-a15d-49e4-975c-bd6c89995ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.496848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2bf9-a15d-49e4-975c-bd6c89995ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.511082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b2bf9-a15d-49e4-975c-bd6c89995ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:26.512607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b2bf9-a15d-49e4-975c-bd6c89995ad0 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:26.527073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 820/1625] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:26.529064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b187-b019-453a-be8c-010bba7c5239 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.529360 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b187-b019-453a-be8c-010bba7c5239 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.529639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b187-b019-453a-be8c-010bba7c5239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.552829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6fe1b187-b019-453a-be8c-010bba7c5239 None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:26.554303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6fe1b187-b019-453a-be8c-010bba7c5239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:26.566324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 821/1626] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jul 14 09:18:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:26.567283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b187-b019-453a-be8c-010bba7c5239 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:26.588241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 806/1627] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jul 14 09:18:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:26.589956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462df21d-7e27-4c27-9b1e-7fc5e809d932 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:26.607158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462df21d-7e27-4c27-9b1e-7fc5e809d932 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:26.631184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d070e-d01b-4771-a5a4-fc51b33174b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:26.633106 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d070e-d01b-4771-a5a4-fc51b33174b5 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.633754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d070e-d01b-4771-a5a4-fc51b33174b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.634578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d070e-d01b-4771-a5a4-fc51b33174b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.641453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b187-b019-453a-be8c-010bba7c5239 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:26.648710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dad7a7-3bf3-4aa1-966b-0b5a393be987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:26.649545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad7a7-3bf3-4aa1-966b-0b5a393be987 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.649857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad7a7-3bf3-4aa1-966b-0b5a393be987 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.650228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad7a7-3bf3-4aa1-966b-0b5a393be987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.653661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d070e-d01b-4771-a5a4-fc51b33174b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:26.658105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d070e-d01b-4771-a5a4-fc51b33174b5 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:26.691172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dad7a7-3bf3-4aa1-966b-0b5a393be987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:26.694179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dad7a7-3bf3-4aa1-966b-0b5a393be987 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:26.694912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 807/1628] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:26.698458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d070e-d01b-4771-a5a4-fc51b33174b5 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:26.721905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 822/1629] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:26 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:26.732452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d070e-d01b-4771-a5a4-fc51b33174b5 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:26.751626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94136830-f40a-456f-a3a6-f7c9a272e958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:26.752364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94136830-f40a-456f-a3a6-f7c9a272e958 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.752651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94136830-f40a-456f-a3a6-f7c9a272e958 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.752975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94136830-f40a-456f-a3a6-f7c9a272e958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.872789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dad7a7-3bf3-4aa1-966b-0b5a393be987 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:26.883458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dad7a7-3bf3-4aa1-966b-0b5a393be987 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:26.891261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f4f4a-c657-46ff-9da0-fc6329c7e57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:26.892944 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f4f4a-c657-46ff-9da0-fc6329c7e57e service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:26.893238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f4f4a-c657-46ff-9da0-fc6329c7e57e service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:26.893520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f4f4a-c657-46ff-9da0-fc6329c7e57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:26.919472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94136830-f40a-456f-a3a6-f7c9a272e958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:26.921489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94136830-f40a-456f-a3a6-f7c9a272e958 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:26.943815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 808/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:26.994707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f4f4a-c657-46ff-9da0-fc6329c7e57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:26.996910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f4f4a-c657-46ff-9da0-fc6329c7e57e service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:27.011323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 823/1631] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:26 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:27.281838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870d644-84b6-45c9-91c4-d8cf6f90f362 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:27.282046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870d644-84b6-45c9-91c4-d8cf6f90f362 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:27.282301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870d644-84b6-45c9-91c4-d8cf6f90f362 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:27.283873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 809/1632] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jul 14 09:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:18:27.295009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b4829-1502-4dd3-b19d-18da2b93149e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:27.295509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b4829-1502-4dd3-b19d-18da2b93149e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:27.295678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b4829-1502-4dd3-b19d-18da2b93149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:27.332803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e57b4829-1502-4dd3-b19d-18da2b93149e None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:27.334430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e57b4829-1502-4dd3-b19d-18da2b93149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:27.355301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 824/1633] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:18:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:18:27.364376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870d644-84b6-45c9-91c4-d8cf6f90f362 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:27.379856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870d644-84b6-45c9-91c4-d8cf6f90f362 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:27.384479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e842042-f52a-45a1-8e93-a7f36b90c48f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:27.385631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e842042-f52a-45a1-8e93-a7f36b90c48f service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:27.386181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e842042-f52a-45a1-8e93-a7f36b90c48f service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:27.386704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e842042-f52a-45a1-8e93-a7f36b90c48f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:27.399756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e842042-f52a-45a1-8e93-a7f36b90c48f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:27.402097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e842042-f52a-45a1-8e93-a7f36b90c48f service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:27.431350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 810/1634] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:27.545878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22a33-2a87-47b1-a27c-48ae31e00e7d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:27.546464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22a33-2a87-47b1-a27c-48ae31e00e7d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:27.546916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22a33-2a87-47b1-a27c-48ae31e00e7d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:27.548952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 825/1635] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jul 14 09:18:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:18:27.562253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e0477-b83d-4596-bc68-7df739862f0b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:27.563121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e0477-b83d-4596-bc68-7df739862f0b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:27.563657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e0477-b83d-4596-bc68-7df739862f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:27.604730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-601e0477-b83d-4596-bc68-7df739862f0b None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:27.608928 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-601e0477-b83d-4596-bc68-7df739862f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:27.649888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 811/1636] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:18:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:27.665588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa22a33-2a87-47b1-a27c-48ae31e00e7d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:27.686523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa22a33-2a87-47b1-a27c-48ae31e00e7d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:27.686523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86b65d-2534-43d2-8349-5f1a07dddb3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:27.688073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86b65d-2534-43d2-8349-5f1a07dddb3a service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:27.688073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86b65d-2534-43d2-8349-5f1a07dddb3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:27.688073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86b65d-2534-43d2-8349-5f1a07dddb3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:27.700528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e0477-b83d-4596-bc68-7df739862f0b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:27.714429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e0477-b83d-4596-bc68-7df739862f0b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:27.729074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:27.731405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:27.731695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:27.732012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86b65d-2534-43d2-8349-5f1a07dddb3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:27.733274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] PATH_INFO: `/v3/users/2f14b049beea4485a52ca3956b1f5063` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:27.734356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86b65d-2534-43d2-8349-5f1a07dddb3a service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:27.736917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f14b049beea4485a52ca3956b1f5063)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:27.741240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:27.779925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 826/1637] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:27.837676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:27.867735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f14b049beea4485a52ca3956b1f5063'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:27.868418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f14b049beea4485a52ca3956b1f5063'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:27.880075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f14b049beea4485a52ca3956b1f5063'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:27.893365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f14b049beea4485a52ca3956b1f5063'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:27.894319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f14b049beea4485a52ca3956b1f5063'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:27.919209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 812/1638] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:18:27 2022] DELETE /identity/v3/users/2f14b049beea4485a52ca3956b1f5063 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:27.923718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b5c19-4492-4bc0-8b2a-0f951982c916 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:27.924018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b5c19-4492-4bc0-8b2a-0f951982c916 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:27.924303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b5c19-4492-4bc0-8b2a-0f951982c916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:27.946029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-776b5c19-4492-4bc0-8b2a-0f951982c916 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:27.947279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-776b5c19-4492-4bc0-8b2a-0f951982c916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:27.954218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:28.037544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 827/1639] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:28.084562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:28.086678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:28.225709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557fceb-4dd1-466d-ab0a-d1dafa399aa0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:28.232270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f0adc-8e6f-4f0a-b314-063858b45023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:28.233213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f0adc-8e6f-4f0a-b314-063858b45023 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:28.233752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f0adc-8e6f-4f0a-b314-063858b45023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:28.234037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f0adc-8e6f-4f0a-b314-063858b45023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:28.249087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f0adc-8e6f-4f0a-b314-063858b45023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:28.252915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f0adc-8e6f-4f0a-b314-063858b45023 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:28.279707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 813/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:30.000822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b5c19-4492-4bc0-8b2a-0f951982c916 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:30.002015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-776b5c19-4492-4bc0-8b2a-0f951982c916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:30.029136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b5c19-4492-4bc0-8b2a-0f951982c916 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:30.050812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:30.052298 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:30.052823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:30.053395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] PATH_INFO: `/v3/projects/60f3a08976a74a8eb6e43aba30d38d36` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:30.063871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f3a08976a74a8eb6e43aba30d38d36)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:30.065859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:30.192375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f3a08976a74a8eb6e43aba30d38d36', 'request_id': 'req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:30.209490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f3a08976a74a8eb6e43aba30d38d36', 'request_id': 'req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:30.226981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f3a08976a74a8eb6e43aba30d38d36', 'request_id': 'req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:30.250935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] The token cache is being invalidate because project 60f3a08976a74a8eb6e43aba30d38d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:18:30.250935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:30.251642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aa92eeb2-8967-4e21-bc9e-20550cc06c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:30.256851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 828/1641] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:18:29 2022] DELETE /identity/v3/projects/60f3a08976a74a8eb6e43aba30d38d36 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:30.258655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b29bd-0bff-4adf-b255-ee493153d5ed None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:30.259233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b29bd-0bff-4adf-b255-ee493153d5ed None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:30.259631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b29bd-0bff-4adf-b255-ee493153d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:30.297001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-415b29bd-0bff-4adf-b255-ee493153d5ed None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:30.298411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-415b29bd-0bff-4adf-b255-ee493153d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:30.459943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 814/1642] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:30.474289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfb9f2-9ee7-44d5-9b54-080c113b9f41 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:30.477542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfb9f2-9ee7-44d5-9b54-080c113b9f41 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:30.478003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfb9f2-9ee7-44d5-9b54-080c113b9f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:30.529042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-04bfb9f2-9ee7-44d5-9b54-080c113b9f41 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:30.530280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-04bfb9f2-9ee7-44d5-9b54-080c113b9f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:30.549512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 829/1643] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:30.551611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b29bd-0bff-4adf-b255-ee493153d5ed None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:30.575144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b29bd-0bff-4adf-b255-ee493153d5ed None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:30.591975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960f7e8-5db2-4cee-8d3b-70ef235a2423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:30.593195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960f7e8-5db2-4cee-8d3b-70ef235a2423 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:30.593657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960f7e8-5db2-4cee-8d3b-70ef235a2423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:30.594052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960f7e8-5db2-4cee-8d3b-70ef235a2423 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:30.594926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960f7e8-5db2-4cee-8d3b-70ef235a2423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:30.595300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960f7e8-5db2-4cee-8d3b-70ef235a2423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:30.598511 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960f7e8-5db2-4cee-8d3b-70ef235a2423 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:30.615382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 815/1644] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:30.619938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfb9f2-9ee7-44d5-9b54-080c113b9f41 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:30.633703 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfb9f2-9ee7-44d5-9b54-080c113b9f41 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:30.646117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41192173-979b-4549-b9ae-a631e77ee4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:30.646117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41192173-979b-4549-b9ae-a631e77ee4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:30.646117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41192173-979b-4549-b9ae-a631e77ee4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:30.646117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41192173-979b-4549-b9ae-a631e77ee4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:30.646687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41192173-979b-4549-b9ae-a631e77ee4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:30.646687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41192173-979b-4549-b9ae-a631e77ee4e2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:30.715534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 830/1645] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:30 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:30.716387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960f7e8-5db2-4cee-8d3b-70ef235a2423 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:30.750024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960f7e8-5db2-4cee-8d3b-70ef235a2423 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:30.891094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:30.954098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c94b7f-cff2-4e39-bbc6-c84a571a1009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:30.955460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94b7f-cff2-4e39-bbc6-c84a571a1009 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:30.955926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94b7f-cff2-4e39-bbc6-c84a571a1009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:30.957659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94b7f-cff2-4e39-bbc6-c84a571a1009 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:30.958704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c94b7f-cff2-4e39-bbc6-c84a571a1009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:30.965220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c94b7f-cff2-4e39-bbc6-c84a571a1009 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:31.038486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 816/1646] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:30 2022] POST /identity/v3/users => generated 290 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:18:31.039983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41192173-979b-4549-b9ae-a631e77ee4e2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:31.056562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41192173-979b-4549-b9ae-a631e77ee4e2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:31.067729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1962d-e64f-4904-992e-de1b5c6c66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:31.068917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1962d-e64f-4904-992e-de1b5c6c66a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:31.069295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1962d-e64f-4904-992e-de1b5c6c66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:31.069574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1962d-e64f-4904-992e-de1b5c6c66a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:31.070659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1962d-e64f-4904-992e-de1b5c6c66a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:31.074637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1962d-e64f-4904-992e-de1b5c6c66a8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:31.103819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 831/1647] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:31.105159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c94b7f-cff2-4e39-bbc6-c84a571a1009 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:31.121817 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c94b7f-cff2-4e39-bbc6-c84a571a1009 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:31.134218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad498da-158e-45d9-a1c5-1c95eaec7eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:31.135339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad498da-158e-45d9-a1c5-1c95eaec7eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:31.135700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad498da-158e-45d9-a1c5-1c95eaec7eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:31.136098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad498da-158e-45d9-a1c5-1c95eaec7eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:31.137446 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad498da-158e-45d9-a1c5-1c95eaec7eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:31.144297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad498da-158e-45d9-a1c5-1c95eaec7eb1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:31.179031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 817/1648] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:31.184409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1962d-e64f-4904-992e-de1b5c6c66a8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:31.196978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1962d-e64f-4904-992e-de1b5c6c66a8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:31.208923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035329-3588-4c16-ab5f-d5b30d2bec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:31.210139 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035329-3588-4c16-ab5f-d5b30d2bec8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:31.214753 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035329-3588-4c16-ab5f-d5b30d2bec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:31.215172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035329-3588-4c16-ab5f-d5b30d2bec8b admin admin] PATH_INFO: `/v3/projects/2f5cc299d7544b0ca7663d2ef8408350/users/eaa3e9ad226449a9b50961ab0c95f247/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:31.258007 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04035329-3588-4c16-ab5f-d5b30d2bec8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5cc299d7544b0ca7663d2ef8408350, user_id=eaa3e9ad226449a9b50961ab0c95f247, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:31.261921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04035329-3588-4c16-ab5f-d5b30d2bec8b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:31.285762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 832/1649] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:31 2022] PUT /identity/v3/projects/2f5cc299d7544b0ca7663d2ef8408350/users/eaa3e9ad226449a9b50961ab0c95f247/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:31.296337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb54f5b-232f-42ac-9091-9ff5b9503742 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:31.296946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb54f5b-232f-42ac-9091-9ff5b9503742 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:31.297015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb54f5b-232f-42ac-9091-9ff5b9503742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:31.345129 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5fb54f5b-232f-42ac-9091-9ff5b9503742 None None] MFA Rules not processed for user `eaa3e9ad226449a9b50961ab0c95f247`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:31.346838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5fb54f5b-232f-42ac-9091-9ff5b9503742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:31.464742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 818/1650] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:31.467040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035329-3588-4c16-ab5f-d5b30d2bec8b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:31.525053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:31.574941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035329-3588-4c16-ab5f-d5b30d2bec8b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:31.581497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3a2e4-1a53-49b0-a972-3edd3a8e9541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:31.582861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3a2e4-1a53-49b0-a972-3edd3a8e9541 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:31.583252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3a2e4-1a53-49b0-a972-3edd3a8e9541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:31.583783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3a2e4-1a53-49b0-a972-3edd3a8e9541 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:31.585958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3a2e4-1a53-49b0-a972-3edd3a8e9541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:31.590824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3a2e4-1a53-49b0-a972-3edd3a8e9541 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:31.629824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 833/1651] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:31 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:31.634333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb54f5b-232f-42ac-9091-9ff5b9503742 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:31.652078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb54f5b-232f-42ac-9091-9ff5b9503742 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:31.727198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c0ec-745b-4f0c-a6c9-9c324465b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:31.728065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c0ec-745b-4f0c-a6c9-9c324465b350 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:31.728442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c0ec-745b-4f0c-a6c9-9c324465b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:31.728856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c0ec-745b-4f0c-a6c9-9c324465b350 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:31.729996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6c0ec-745b-4f0c-a6c9-9c324465b350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:31.731783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6c0ec-745b-4f0c-a6c9-9c324465b350 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:31.757828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 819/1652] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:31 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:31.763152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3a2e4-1a53-49b0-a972-3edd3a8e9541 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:31.774909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3a2e4-1a53-49b0-a972-3edd3a8e9541 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:31.781207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab0e9a-6ee0-4bf4-a0ed-a453cf0a576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:31.782666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab0e9a-6ee0-4bf4-a0ed-a453cf0a576a admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:31.782963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab0e9a-6ee0-4bf4-a0ed-a453cf0a576a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:31.783327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab0e9a-6ee0-4bf4-a0ed-a453cf0a576a admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:31.785049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab0e9a-6ee0-4bf4-a0ed-a453cf0a576a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:31.792126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab0e9a-6ee0-4bf4-a0ed-a453cf0a576a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:31.808382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 834/1653] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:31.812383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c0ec-745b-4f0c-a6c9-9c324465b350 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:31.824064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c0ec-745b-4f0c-a6c9-9c324465b350 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:31.829363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60574133-5ada-4fd8-a3fc-320f63e9716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:31.830430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60574133-5ada-4fd8-a3fc-320f63e9716a admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:31.830814 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60574133-5ada-4fd8-a3fc-320f63e9716a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:31.831258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60574133-5ada-4fd8-a3fc-320f63e9716a admin admin] PATH_INFO: `/v3/projects/7d7ff0811b90450b939387b82c6eb754/users/03366852e6eb4cad89d1568bddc33199/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:31.852051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60574133-5ada-4fd8-a3fc-320f63e9716a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7ff0811b90450b939387b82c6eb754, user_id=03366852e6eb4cad89d1568bddc33199, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:31.855415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60574133-5ada-4fd8-a3fc-320f63e9716a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:31.878597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 820/1654] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:31 2022] PUT /identity/v3/projects/7d7ff0811b90450b939387b82c6eb754/users/03366852e6eb4cad89d1568bddc33199/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:18:31.885163 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab0e9a-6ee0-4bf4-a0ed-a453cf0a576a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:31.899508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab0e9a-6ee0-4bf4-a0ed-a453cf0a576a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:32.021877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3dfa36-bcbe-4ebf-ad27-360d669aa079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:32.022934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dfa36-bcbe-4ebf-ad27-360d669aa079 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:32.025388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dfa36-bcbe-4ebf-ad27-360d669aa079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:32.025762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dfa36-bcbe-4ebf-ad27-360d669aa079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:32.026605 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3dfa36-bcbe-4ebf-ad27-360d669aa079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:32.028309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3dfa36-bcbe-4ebf-ad27-360d669aa079 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:32.046284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 835/1655] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:32.050120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60574133-5ada-4fd8-a3fc-320f63e9716a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:32.064631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60574133-5ada-4fd8-a3fc-320f63e9716a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:32.073277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc401c3-ba5d-4441-86e3-f234f9f842c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:32.074464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc401c3-ba5d-4441-86e3-f234f9f842c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:32.074888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc401c3-ba5d-4441-86e3-f234f9f842c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:32.075346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc401c3-ba5d-4441-86e3-f234f9f842c0 admin admin] PATH_INFO: `/v3/projects/7d7ff0811b90450b939387b82c6eb754/users/03366852e6eb4cad89d1568bddc33199/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:32.078724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc401c3-ba5d-4441-86e3-f234f9f842c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7ff0811b90450b939387b82c6eb754, user_id=03366852e6eb4cad89d1568bddc33199, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:32.083608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc401c3-ba5d-4441-86e3-f234f9f842c0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:32.094107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:32.113219 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 821/1656] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:32 2022] PUT /identity/v3/projects/7d7ff0811b90450b939387b82c6eb754/users/03366852e6eb4cad89d1568bddc33199/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:18:32.116541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb644ed7-b164-4d94-844b-1f477a2e0fb7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:32.116796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb644ed7-b164-4d94-844b-1f477a2e0fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:32.117080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb644ed7-b164-4d94-844b-1f477a2e0fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:32.184758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-eb644ed7-b164-4d94-844b-1f477a2e0fb7 None None] MFA Rules not processed for user `03366852e6eb4cad89d1568bddc33199`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:32.186033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-eb644ed7-b164-4d94-844b-1f477a2e0fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:32.386579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 836/1657] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:32.559777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc401c3-ba5d-4441-86e3-f234f9f842c0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:32.562867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ecc401c3-ba5d-4441-86e3-f234f9f842c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:32.769578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc401c3-ba5d-4441-86e3-f234f9f842c0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:32.781099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b789ae7-9ce3-4da7-b179-fd4f401bb501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:32.782396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b789ae7-9ce3-4da7-b179-fd4f401bb501 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:32.784321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b789ae7-9ce3-4da7-b179-fd4f401bb501 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:32.784699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b789ae7-9ce3-4da7-b179-fd4f401bb501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:32.856771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b789ae7-9ce3-4da7-b179-fd4f401bb501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:32.863197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b789ae7-9ce3-4da7-b179-fd4f401bb501 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:32.890365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 822/1658] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:33.033415 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb644ed7-b164-4d94-844b-1f477a2e0fb7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:33.045034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb644ed7-b164-4d94-844b-1f477a2e0fb7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:33.056915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cdcc1-0ec9-4f50-a3f3-a5b0e46a6003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:33.057903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cdcc1-0ec9-4f50-a3f3-a5b0e46a6003 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:33.058407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cdcc1-0ec9-4f50-a3f3-a5b0e46a6003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:33.059006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cdcc1-0ec9-4f50-a3f3-a5b0e46a6003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:33.111417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:33.193595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cdcc1-0ec9-4f50-a3f3-a5b0e46a6003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:33.198545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cdcc1-0ec9-4f50-a3f3-a5b0e46a6003 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:33.218297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 837/1659] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:33.985006 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b789ae7-9ce3-4da7-b179-fd4f401bb501 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:33.986575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0b789ae7-9ce3-4da7-b179-fd4f401bb501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:34.151747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b789ae7-9ce3-4da7-b179-fd4f401bb501 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:34.173953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:34.174901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:34.175184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:34.175496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] PATH_INFO: `/v3/users/b458732ea150427f98eded06b87a8f33` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:34.178122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b458732ea150427f98eded06b87a8f33)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:34.181851 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:34.279686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d7f85-0ffb-4ce9-a12d-623556ea9388 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:34.280226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d7f85-0ffb-4ce9-a12d-623556ea9388 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:34.280226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d7f85-0ffb-4ce9-a12d-623556ea9388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:34.303910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b458732ea150427f98eded06b87a8f33'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:34.307486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b458732ea150427f98eded06b87a8f33'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:34.335540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b458732ea150427f98eded06b87a8f33'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:34.342713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-094d7f85-0ffb-4ce9-a12d-623556ea9388 None None] MFA Rules not processed for user `f354a75ed51144769da1db0ec92e7980`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:34.344739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-094d7f85-0ffb-4ce9-a12d-623556ea9388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:34.354290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b458732ea150427f98eded06b87a8f33'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:34.358175 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1442b828-ccd8-4d96-8d5c-8ceceaa87ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b458732ea150427f98eded06b87a8f33'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:34.406052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 823/1660] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:18:33 2022] DELETE /identity/v3/users/b458732ea150427f98eded06b87a8f33 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:34.411241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9c19-6a2b-4112-8f99-82153884d4ca None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:34.411540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9c19-6a2b-4112-8f99-82153884d4ca None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:34.411823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9c19-6a2b-4112-8f99-82153884d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:34.454733 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-74bf9c19-6a2b-4112-8f99-82153884d4ca None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:34.457465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-74bf9c19-6a2b-4112-8f99-82153884d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:34.512064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:34.571471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 838/1661] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:18:34.590991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d7f85-0ffb-4ce9-a12d-623556ea9388 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:34.594350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-094d7f85-0ffb-4ce9-a12d-623556ea9388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:34.652698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 824/1662] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:34.664553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf9c19-6a2b-4112-8f99-82153884d4ca None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:34.668267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-74bf9c19-6a2b-4112-8f99-82153884d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:34.779539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d7f85-0ffb-4ce9-a12d-623556ea9388 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:34.800853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf9c19-6a2b-4112-8f99-82153884d4ca None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:34.817048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549671c-324e-484c-ae12-f862a85ac62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:34.817738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549671c-324e-484c-ae12-f862a85ac62b service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:34.820696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549671c-324e-484c-ae12-f862a85ac62b service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:34.821223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549671c-324e-484c-ae12-f862a85ac62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:34.846563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549671c-324e-484c-ae12-f862a85ac62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:34.848487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549671c-324e-484c-ae12-f862a85ac62b service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:34.877803 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 825/1663] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:34.902891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:34.935633 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d8054-d7d8-4eb7-9e77-4b5a25a865ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:34.943138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d8054-d7d8-4eb7-9e77-4b5a25a865ac service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:34.943138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d8054-d7d8-4eb7-9e77-4b5a25a865ac service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:34.943138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d8054-d7d8-4eb7-9e77-4b5a25a865ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:35.083593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d8054-d7d8-4eb7-9e77-4b5a25a865ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:35.086489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d8054-d7d8-4eb7-9e77-4b5a25a865ac service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:35.113897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 839/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:35.559495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549671c-324e-484c-ae12-f862a85ac62b service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:35.563856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1549671c-324e-484c-ae12-f862a85ac62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:35.609414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549671c-324e-484c-ae12-f862a85ac62b service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:35.666633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:35.677604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:35.678295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:35.679027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] PATH_INFO: `/v3/projects/bab125ba76b240c5ad1aff3a185c609e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:35.681582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab125ba76b240c5ad1aff3a185c609e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:35.683497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:18:35.683497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 14 09:18:35.683497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: Jul 14 09:18:35.685169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:35.886907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab125ba76b240c5ad1aff3a185c609e', 'request_id': 'req-ad568efc-639e-45af-b9a7-14d3d7bf7076'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:35.911921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab125ba76b240c5ad1aff3a185c609e', 'request_id': 'req-ad568efc-639e-45af-b9a7-14d3d7bf7076'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:35.957894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab125ba76b240c5ad1aff3a185c609e', 'request_id': 'req-ad568efc-639e-45af-b9a7-14d3d7bf7076'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:35.986725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] The token cache is being invalidate because project bab125ba76b240c5ad1aff3a185c609e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:18:35.987294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:35.988417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad568efc-639e-45af-b9a7-14d3d7bf7076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:35.995618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 826/1665] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:18:35 2022] DELETE /identity/v3/projects/bab125ba76b240c5ad1aff3a185c609e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:35.997485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137c175-b67f-48d1-a3b2-de897dfff297 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:35.998001 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137c175-b67f-48d1-a3b2-de897dfff297 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:35.998070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137c175-b67f-48d1-a3b2-de897dfff297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:36.037522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8137c175-b67f-48d1-a3b2-de897dfff297 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:36.038962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8137c175-b67f-48d1-a3b2-de897dfff297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:36.187617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441761-a8b9-4977-abaa-7687472b42fd None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:36.188227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441761-a8b9-4977-abaa-7687472b42fd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:36.188692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441761-a8b9-4977-abaa-7687472b42fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:36.191222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 840/1666] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:18:36.220926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ee441761-a8b9-4977-abaa-7687472b42fd None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:36.222736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ee441761-a8b9-4977-abaa-7687472b42fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:36.242322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137c175-b67f-48d1-a3b2-de897dfff297 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:36.245077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 827/1667] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:36.257773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137c175-b67f-48d1-a3b2-de897dfff297 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:36.271197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa7618-5794-4d0f-bb57-cf035727209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:36.272092 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa7618-5794-4d0f-bb57-cf035727209f admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:36.272196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa7618-5794-4d0f-bb57-cf035727209f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:36.274602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa7618-5794-4d0f-bb57-cf035727209f admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:36.276577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa7618-5794-4d0f-bb57-cf035727209f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:36.277049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa7618-5794-4d0f-bb57-cf035727209f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:36.281803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa7618-5794-4d0f-bb57-cf035727209f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:36.311506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee441761-a8b9-4977-abaa-7687472b42fd None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:36.317216 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 841/1668] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:36.327427 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee441761-a8b9-4977-abaa-7687472b42fd None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:36.338286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b4791-424f-42c4-a577-5080d3a0fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:36.339090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4791-424f-42c4-a577-5080d3a0fcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:36.339489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4791-424f-42c4-a577-5080d3a0fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:36.339776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4791-424f-42c4-a577-5080d3a0fcf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:36.340691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b4791-424f-42c4-a577-5080d3a0fcf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:36.344749 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b4791-424f-42c4-a577-5080d3a0fcf8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:36.409563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 828/1669] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:36 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:18:36.409992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa7618-5794-4d0f-bb57-cf035727209f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:36.435994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa7618-5794-4d0f-bb57-cf035727209f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:36.503597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d170d3-e8a0-49e5-8390-2129ebf4229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:36.504358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d170d3-e8a0-49e5-8390-2129ebf4229b admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:36.504774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d170d3-e8a0-49e5-8390-2129ebf4229b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:36.505116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d170d3-e8a0-49e5-8390-2129ebf4229b admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:36.505938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d170d3-e8a0-49e5-8390-2129ebf4229b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:36.508255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d170d3-e8a0-49e5-8390-2129ebf4229b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:36.546525 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 842/1670] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:36 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:36.548043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b4791-424f-42c4-a577-5080d3a0fcf8 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:36.564562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b4791-424f-42c4-a577-5080d3a0fcf8 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:36.577522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a70b1-ea23-4dbd-9fbf-7f402badbc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:36.579191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a70b1-ea23-4dbd-9fbf-7f402badbc35 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:36.579735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a70b1-ea23-4dbd-9fbf-7f402badbc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:36.580224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a70b1-ea23-4dbd-9fbf-7f402badbc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:36.581234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a70b1-ea23-4dbd-9fbf-7f402badbc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:36.585389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a70b1-ea23-4dbd-9fbf-7f402badbc35 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:36.602972 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 829/1671] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:36.606831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d170d3-e8a0-49e5-8390-2129ebf4229b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:36.627938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d170d3-e8a0-49e5-8390-2129ebf4229b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:36.658292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625836a-cec7-42bd-99ef-7ee378bb7f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:36.659454 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625836a-cec7-42bd-99ef-7ee378bb7f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:36.659741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625836a-cec7-42bd-99ef-7ee378bb7f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:36.660015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625836a-cec7-42bd-99ef-7ee378bb7f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:36.660803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625836a-cec7-42bd-99ef-7ee378bb7f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:36.662487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625836a-cec7-42bd-99ef-7ee378bb7f65 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:36.664380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:36.706515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a70b1-ea23-4dbd-9fbf-7f402badbc35 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:36.707884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 843/1672] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:18:36.720502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a70b1-ea23-4dbd-9fbf-7f402badbc35 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:36.725825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08110394-9517-4ee7-8a64-acb731e4be46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:36.726802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08110394-9517-4ee7-8a64-acb731e4be46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:36.727087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08110394-9517-4ee7-8a64-acb731e4be46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:36.727361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08110394-9517-4ee7-8a64-acb731e4be46 admin admin] PATH_INFO: `/v3/projects/4c7a86b9643c4d86ac9d306a6df9eaef/users/c447e250260b47d7a3ebd0cc0795ffa9/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:36.731932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:36.749592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08110394-9517-4ee7-8a64-acb731e4be46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7a86b9643c4d86ac9d306a6df9eaef, user_id=c447e250260b47d7a3ebd0cc0795ffa9, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:36.754694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08110394-9517-4ee7-8a64-acb731e4be46 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:36.793862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 830/1673] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:36 2022] PUT /identity/v3/projects/4c7a86b9643c4d86ac9d306a6df9eaef/users/c447e250260b47d7a3ebd0cc0795ffa9/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:18:36.805424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c37ea-9440-452a-ba0c-f609ac2c048e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:36.806134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c37ea-9440-452a-ba0c-f609ac2c048e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:36.806134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c37ea-9440-452a-ba0c-f609ac2c048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:36.861617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d89c37ea-9440-452a-ba0c-f609ac2c048e None None] MFA Rules not processed for user `c447e250260b47d7a3ebd0cc0795ffa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:36.863430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d89c37ea-9440-452a-ba0c-f609ac2c048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:36.971552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 844/1674] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:36.975829 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08110394-9517-4ee7-8a64-acb731e4be46 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:37.130969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08110394-9517-4ee7-8a64-acb731e4be46 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:37.156145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ac354-d3e0-44ea-bab1-a7a8710c8042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:37.156880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ac354-d3e0-44ea-bab1-a7a8710c8042 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:37.157165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ac354-d3e0-44ea-bab1-a7a8710c8042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:37.157441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ac354-d3e0-44ea-bab1-a7a8710c8042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:37.158244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ac354-d3e0-44ea-bab1-a7a8710c8042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:37.173414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ac354-d3e0-44ea-bab1-a7a8710c8042 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:37.250393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 831/1675] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:36 2022] POST /identity/v3/projects => generated 365 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:37.255531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c37ea-9440-452a-ba0c-f609ac2c048e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:37.275764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c37ea-9440-452a-ba0c-f609ac2c048e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:37.460497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cab33-2a3d-427f-aa39-2a83de5e0d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:37.462315 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cab33-2a3d-427f-aa39-2a83de5e0d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:37.462796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cab33-2a3d-427f-aa39-2a83de5e0d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:37.463402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cab33-2a3d-427f-aa39-2a83de5e0d4a admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:37.464440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cab33-2a3d-427f-aa39-2a83de5e0d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:37.468125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cab33-2a3d-427f-aa39-2a83de5e0d4a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:37.511059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 845/1676] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:37 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:37.514558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ac354-d3e0-44ea-bab1-a7a8710c8042 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:37.529487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ac354-d3e0-44ea-bab1-a7a8710c8042 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:37.536646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ddef4-14bf-4c6c-85c4-5c8d4c0b2980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:37.537650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ddef4-14bf-4c6c-85c4-5c8d4c0b2980 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:37.538187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ddef4-14bf-4c6c-85c4-5c8d4c0b2980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:37.539248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ddef4-14bf-4c6c-85c4-5c8d4c0b2980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:37.540225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ddef4-14bf-4c6c-85c4-5c8d4c0b2980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:37.542080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ddef4-14bf-4c6c-85c4-5c8d4c0b2980 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:37.572325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 832/1677] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:37.577039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cab33-2a3d-427f-aa39-2a83de5e0d4a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:37.595020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cab33-2a3d-427f-aa39-2a83de5e0d4a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:37.609617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ba4ce-ccf8-4430-8e11-7f2426e04628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:37.610537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ba4ce-ccf8-4430-8e11-7f2426e04628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:37.610998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ba4ce-ccf8-4430-8e11-7f2426e04628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:37.611282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ba4ce-ccf8-4430-8e11-7f2426e04628 admin admin] PATH_INFO: `/v3/projects/1f028505b7d14b65b02eafdf1f76942e/users/f5b7462fc2244b2b80b10970bf474897/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:37.636089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ba4ce-ccf8-4430-8e11-7f2426e04628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f028505b7d14b65b02eafdf1f76942e, user_id=f5b7462fc2244b2b80b10970bf474897, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:37.639811 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ba4ce-ccf8-4430-8e11-7f2426e04628 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:37.663864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 846/1678] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:37 2022] PUT /identity/v3/projects/1f028505b7d14b65b02eafdf1f76942e/users/f5b7462fc2244b2b80b10970bf474897/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:37.667972 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ddef4-14bf-4c6c-85c4-5c8d4c0b2980 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:37.681790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ddef4-14bf-4c6c-85c4-5c8d4c0b2980 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:37.849707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09471aee-6f05-4b3f-9df6-e6346ad0c012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:37.851739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471aee-6f05-4b3f-9df6-e6346ad0c012 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:37.853470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471aee-6f05-4b3f-9df6-e6346ad0c012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:37.854101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09471aee-6f05-4b3f-9df6-e6346ad0c012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:37.857045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09471aee-6f05-4b3f-9df6-e6346ad0c012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:37.860307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09471aee-6f05-4b3f-9df6-e6346ad0c012 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:37.889991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 833/1679] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:37.894425 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ba4ce-ccf8-4430-8e11-7f2426e04628 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:37.912153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ba4ce-ccf8-4430-8e11-7f2426e04628 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:37.934562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d966d-018d-4f5d-a60c-fa4afb0fc3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:37.935598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d966d-018d-4f5d-a60c-fa4afb0fc3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:37.935977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d966d-018d-4f5d-a60c-fa4afb0fc3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:37.936345 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d966d-018d-4f5d-a60c-fa4afb0fc3f9 admin admin] PATH_INFO: `/v3/projects/1f028505b7d14b65b02eafdf1f76942e/users/f5b7462fc2244b2b80b10970bf474897/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:37.940468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d966d-018d-4f5d-a60c-fa4afb0fc3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f028505b7d14b65b02eafdf1f76942e, user_id=f5b7462fc2244b2b80b10970bf474897, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:37.948710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d966d-018d-4f5d-a60c-fa4afb0fc3f9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:37.982649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 847/1680] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:37 2022] PUT /identity/v3/projects/1f028505b7d14b65b02eafdf1f76942e/users/f5b7462fc2244b2b80b10970bf474897/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:37.995236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864e102-07ea-49eb-a8fe-8bf6296f2fae None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:37.996080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864e102-07ea-49eb-a8fe-8bf6296f2fae None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:37.996869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864e102-07ea-49eb-a8fe-8bf6296f2fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:38.063571 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f864e102-07ea-49eb-a8fe-8bf6296f2fae None None] MFA Rules not processed for user `f5b7462fc2244b2b80b10970bf474897`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:38.067296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f864e102-07ea-49eb-a8fe-8bf6296f2fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:38.180003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:38.254468 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 834/1681] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:38.267662 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d966d-018d-4f5d-a60c-fa4afb0fc3f9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:38.270357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-254d966d-018d-4f5d-a60c-fa4afb0fc3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:38.404252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:38.462759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d966d-018d-4f5d-a60c-fa4afb0fc3f9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:38.473768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350dbe5-9f64-4563-a8cf-501a0291cbad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:38.473768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350dbe5-9f64-4563-a8cf-501a0291cbad service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:38.473768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350dbe5-9f64-4563-a8cf-501a0291cbad service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:38.473768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350dbe5-9f64-4563-a8cf-501a0291cbad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:38.507127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350dbe5-9f64-4563-a8cf-501a0291cbad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:38.512242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350dbe5-9f64-4563-a8cf-501a0291cbad service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:38.576778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 848/1682] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:38.759822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864e102-07ea-49eb-a8fe-8bf6296f2fae None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:38.779441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864e102-07ea-49eb-a8fe-8bf6296f2fae None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:38.798756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847dd6c-05ac-41aa-ba94-284f6d296f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:38.803849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847dd6c-05ac-41aa-ba94-284f6d296f5d service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:38.804295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847dd6c-05ac-41aa-ba94-284f6d296f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:38.804606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847dd6c-05ac-41aa-ba94-284f6d296f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:38.976747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847dd6c-05ac-41aa-ba94-284f6d296f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:38.983015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847dd6c-05ac-41aa-ba94-284f6d296f5d service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:39.015333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 835/1683] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:41.202638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857b1e3-f2c0-4c36-8dcd-7e817d4aa311 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:41.203143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857b1e3-f2c0-4c36-8dcd-7e817d4aa311 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:41.203217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857b1e3-f2c0-4c36-8dcd-7e817d4aa311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:41.291733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8857b1e3-f2c0-4c36-8dcd-7e817d4aa311 None None] MFA Rules not processed for user `79ac3d72bfd44bb6a79fd37466aa8092`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:41.293067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8857b1e3-f2c0-4c36-8dcd-7e817d4aa311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:41.429591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 849/1684] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:41.440437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff775d0-0abf-4fc7-8569-642579c5e4c4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:41.441017 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff775d0-0abf-4fc7-8569-642579c5e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:41.441017 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff775d0-0abf-4fc7-8569-642579c5e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:41.481877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0ff775d0-0abf-4fc7-8569-642579c5e4c4 None None] MFA Rules not processed for user `79ac3d72bfd44bb6a79fd37466aa8092`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:41.483201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0ff775d0-0abf-4fc7-8569-642579c5e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:41.503438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 836/1685] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:41.517859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857b1e3-f2c0-4c36-8dcd-7e817d4aa311 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:41.519717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8857b1e3-f2c0-4c36-8dcd-7e817d4aa311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:41.684096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857b1e3-f2c0-4c36-8dcd-7e817d4aa311 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:41.700609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db3837-2d12-478d-926c-e24f2a4bd562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:41.701419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db3837-2d12-478d-926c-e24f2a4bd562 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:41.701708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db3837-2d12-478d-926c-e24f2a4bd562 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:41.701988 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db3837-2d12-478d-926c-e24f2a4bd562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:41.729951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db3837-2d12-478d-926c-e24f2a4bd562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:41.731607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db3837-2d12-478d-926c-e24f2a4bd562 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:41.778693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 850/1686] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:42.143165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff775d0-0abf-4fc7-8569-642579c5e4c4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:42.147009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0ff775d0-0abf-4fc7-8569-642579c5e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:42.260337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff775d0-0abf-4fc7-8569-642579c5e4c4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:42.267664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:42.268907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:42.269414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:42.269927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] PATH_INFO: `/v3/users/eaa3e9ad226449a9b50961ab0c95f247` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:42.271616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa3e9ad226449a9b50961ab0c95f247)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:42.278187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:42.372450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa3e9ad226449a9b50961ab0c95f247'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:42.373543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa3e9ad226449a9b50961ab0c95f247'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:42.385470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa3e9ad226449a9b50961ab0c95f247'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:42.399019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa3e9ad226449a9b50961ab0c95f247'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:42.400091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa3e9ad226449a9b50961ab0c95f247'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:42.413889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:42.436761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 837/1687] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:18:42 2022] DELETE /identity/v3/users/eaa3e9ad226449a9b50961ab0c95f247 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:42.439357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704bec-5b97-414d-857d-dfed02da0f2b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:42.440332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704bec-5b97-414d-857d-dfed02da0f2b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:42.440907 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704bec-5b97-414d-857d-dfed02da0f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:42.481800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-25704bec-5b97-414d-857d-dfed02da0f2b None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:42.488233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-25704bec-5b97-414d-857d-dfed02da0f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:42.582806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:42.648463 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 851/1688] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:42.678069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:42.679613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:42.794552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25704bec-5b97-414d-857d-dfed02da0f2b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:42.796634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-25704bec-5b97-414d-857d-dfed02da0f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:42.811261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955519bf-92aa-4e20-8b2e-331d529cdaf2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:42.821175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25704bec-5b97-414d-857d-dfed02da0f2b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:42.823258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa891c-ec86-473f-b1ba-44404344f138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:42.829850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa891c-ec86-473f-b1ba-44404344f138 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:42.832840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa891c-ec86-473f-b1ba-44404344f138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:42.833290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa891c-ec86-473f-b1ba-44404344f138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:42.844617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:42.845862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:42.846383 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:42.846857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] PATH_INFO: `/v3/users/c447e250260b47d7a3ebd0cc0795ffa9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:42.848617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c447e250260b47d7a3ebd0cc0795ffa9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:42.849876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:18:42.849876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 14 09:18:42.849876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: Jul 14 09:18:42.852556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:42.859888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa891c-ec86-473f-b1ba-44404344f138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:42.862484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa891c-ec86-473f-b1ba-44404344f138 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:42.888993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 838/1689] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:42.958898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c447e250260b47d7a3ebd0cc0795ffa9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:42.970557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c447e250260b47d7a3ebd0cc0795ffa9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:42.971333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c447e250260b47d7a3ebd0cc0795ffa9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:42.986195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c447e250260b47d7a3ebd0cc0795ffa9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:42.988168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e0a5b254-e0b5-4d7b-b568-4aba19872d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c447e250260b47d7a3ebd0cc0795ffa9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:43.026241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 852/1690] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:18:42 2022] DELETE /identity/v3/users/c447e250260b47d7a3ebd0cc0795ffa9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:18:43.031099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c377e-d692-4053-97eb-e987fdf8a463 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:43.031690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c377e-d692-4053-97eb-e987fdf8a463 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:43.032116 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c377e-d692-4053-97eb-e987fdf8a463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:43.066587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-664c377e-d692-4053-97eb-e987fdf8a463 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:43.067881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-664c377e-d692-4053-97eb-e987fdf8a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:43.189439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 839/1691] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:43.275346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba2836-1355-4a65-9487-03ec9378798c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:43.275685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba2836-1355-4a65-9487-03ec9378798c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:43.275917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba2836-1355-4a65-9487-03ec9378798c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:43.277790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 853/1692] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jul 14 09:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:18:43.283976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e658336-84b2-4979-b226-62d8955c80e2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:43.284306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e658336-84b2-4979-b226-62d8955c80e2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:43.284542 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e658336-84b2-4979-b226-62d8955c80e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:43.357101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3e658336-84b2-4979-b226-62d8955c80e2 None None] MFA Rules not processed for user `60db5d8bc4cb4ce7af8bfac2c4eb2390`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:43.358344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3e658336-84b2-4979-b226-62d8955c80e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:43.462254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba2836-1355-4a65-9487-03ec9378798c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:43.464362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-30ba2836-1355-4a65-9487-03ec9378798c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:43.496009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 840/1693] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:18:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:43.584553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba2836-1355-4a65-9487-03ec9378798c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:43.594404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836db37-ba70-466b-8fd2-18e7fe3f35a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:43.594893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836db37-ba70-466b-8fd2-18e7fe3f35a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:43.596342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836db37-ba70-466b-8fd2-18e7fe3f35a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:43.598170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836db37-ba70-466b-8fd2-18e7fe3f35a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:43.607280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e658336-84b2-4979-b226-62d8955c80e2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:43.608890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3e658336-84b2-4979-b226-62d8955c80e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:43.624087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e658336-84b2-4979-b226-62d8955c80e2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:43.627340 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836db37-ba70-466b-8fd2-18e7fe3f35a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:43.636684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836db37-ba70-466b-8fd2-18e7fe3f35a5 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:43.646266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f0f7b-bdb1-426b-aefb-f4fc7030be50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:43.647341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f0f7b-bdb1-426b-aefb-f4fc7030be50 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:43.648433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f0f7b-bdb1-426b-aefb-f4fc7030be50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:43.649641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f0f7b-bdb1-426b-aefb-f4fc7030be50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:43.655860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 854/1694] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:43.663734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f0f7b-bdb1-426b-aefb-f4fc7030be50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:43.666739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f0f7b-bdb1-426b-aefb-f4fc7030be50 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:43.684878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 841/1695] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:45.255646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836db37-ba70-466b-8fd2-18e7fe3f35a5 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:45.257410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5836db37-ba70-466b-8fd2-18e7fe3f35a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:45.281406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836db37-ba70-466b-8fd2-18e7fe3f35a5 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:45.298253 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:45.299287 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:45.299729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:45.300184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] PATH_INFO: `/v3/projects/2f5cc299d7544b0ca7663d2ef8408350` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:45.302429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5cc299d7544b0ca7663d2ef8408350)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:45.314976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:45.497617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5cc299d7544b0ca7663d2ef8408350', 'request_id': 'req-7847f41c-f302-4f53-ab85-ac6edcfeae05'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:45.542216 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5cc299d7544b0ca7663d2ef8408350', 'request_id': 'req-7847f41c-f302-4f53-ab85-ac6edcfeae05'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:45.559321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5cc299d7544b0ca7663d2ef8408350', 'request_id': 'req-7847f41c-f302-4f53-ab85-ac6edcfeae05'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:45.560987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:45.591669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] The token cache is being invalidate because project 2f5cc299d7544b0ca7663d2ef8408350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:18:45.597279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:45.602964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7847f41c-f302-4f53-ab85-ac6edcfeae05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:45.627459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 855/1696] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:18:45 2022] DELETE /identity/v3/projects/2f5cc299d7544b0ca7663d2ef8408350 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:45.628798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f0f7b-bdb1-426b-aefb-f4fc7030be50 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:45.649704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f0f7b-bdb1-426b-aefb-f4fc7030be50 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:45.715936 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69124e41-d493-4a5d-88ff-b595435f7c04 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:45.717143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69124e41-d493-4a5d-88ff-b595435f7c04 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:45.717571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69124e41-d493-4a5d-88ff-b595435f7c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:45.725927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:45.773551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-69124e41-d493-4a5d-88ff-b595435f7c04 None None] MFA Rules not processed for user `f354a75ed51144769da1db0ec92e7980`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:45.778647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-69124e41-d493-4a5d-88ff-b595435f7c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:45.866872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:45.868170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:45.868640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:45.869132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] PATH_INFO: `/v3/users/03366852e6eb4cad89d1568bddc33199` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:45.870807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=03366852e6eb4cad89d1568bddc33199)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:45.873075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:45.963469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 856/1697] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:18:45.981467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03366852e6eb4cad89d1568bddc33199'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:45.982586 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03366852e6eb4cad89d1568bddc33199'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:46.011558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03366852e6eb4cad89d1568bddc33199'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:46.050229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03366852e6eb4cad89d1568bddc33199'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:46.053196 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816e3ea5-0aa1-43b9-90fa-a44809974c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03366852e6eb4cad89d1568bddc33199'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:46.117062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 842/1698] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:18:45 2022] DELETE /identity/v3/users/03366852e6eb4cad89d1568bddc33199 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:46.225016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e9c5c-18c1-42a4-9ada-cec16f0df773 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:46.225284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e9c5c-18c1-42a4-9ada-cec16f0df773 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:46.226516 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e9c5c-18c1-42a4-9ada-cec16f0df773 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:46.228315 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 857/1699] 10.222.0.27 () {54 vars in 960 bytes} [Thu Jul 14 09:18:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:18:46.243779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996558-a5cf-4428-a67b-32031c943d12 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:46.244324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996558-a5cf-4428-a67b-32031c943d12 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:46.244878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996558-a5cf-4428-a67b-32031c943d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:46.324653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e2996558-a5cf-4428-a67b-32031c943d12 None None] MFA Rules not processed for user `58986e97f4d849aba35149d3666db015`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:46.328450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e2996558-a5cf-4428-a67b-32031c943d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:46.487259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e9c5c-18c1-42a4-9ada-cec16f0df773 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:46.489530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-903e9c5c-18c1-42a4-9ada-cec16f0df773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:46.555916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 843/1700] 10.222.0.27 () {58 vars in 1057 bytes} [Thu Jul 14 09:18:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:46.568743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996558-a5cf-4428-a67b-32031c943d12 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:46.583670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996558-a5cf-4428-a67b-32031c943d12 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:46.602191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e15bb-449c-404a-bb83-ba126d3b59d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:46.603286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e15bb-449c-404a-bb83-ba126d3b59d9 service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:46.603711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e15bb-449c-404a-bb83-ba126d3b59d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:46.604196 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e15bb-449c-404a-bb83-ba126d3b59d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:46.609335 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a79e15bb-449c-404a-bb83-ba126d3b59d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:46.627250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e15bb-449c-404a-bb83-ba126d3b59d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:46.631492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e15bb-449c-404a-bb83-ba126d3b59d9 service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:46.653880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 844/1701] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:18:46.741108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e9c5c-18c1-42a4-9ada-cec16f0df773 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:46.766794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:46.767862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:46.768257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:46.768644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] PATH_INFO: `/v3/projects/4c7a86b9643c4d86ac9d306a6df9eaef` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:46.769992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7a86b9643c4d86ac9d306a6df9eaef)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:46.772081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:46.954618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7a86b9643c4d86ac9d306a6df9eaef', 'request_id': 'req-96520c04-ef8a-4fb4-bd90-71367078ce22'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:46.969615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7a86b9643c4d86ac9d306a6df9eaef', 'request_id': 'req-96520c04-ef8a-4fb4-bd90-71367078ce22'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:46.986674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7a86b9643c4d86ac9d306a6df9eaef', 'request_id': 'req-96520c04-ef8a-4fb4-bd90-71367078ce22'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:47.015787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] The token cache is being invalidate because project 4c7a86b9643c4d86ac9d306a6df9eaef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:18:47.016087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:47.016839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96520c04-ef8a-4fb4-bd90-71367078ce22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:47.020580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 858/1702] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:18:46 2022] DELETE /identity/v3/projects/4c7a86b9643c4d86ac9d306a6df9eaef => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:18:47.025210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e15bb-449c-404a-bb83-ba126d3b59d9 service placement] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:47.042419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e15bb-449c-404a-bb83-ba126d3b59d9 service placement] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:47.105796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:47.215436 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:47.217005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:47.217311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:47.217725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] PATH_INFO: `/v3/users/f5b7462fc2244b2b80b10970bf474897` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:47.220809 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b7462fc2244b2b80b10970bf474897)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:47.227829 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:47.329242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c869-1ab2-4f43-bc22-88575d6c1226 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:47.329559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c869-1ab2-4f43-bc22-88575d6c1226 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:47.329841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c869-1ab2-4f43-bc22-88575d6c1226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:47.355413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b7462fc2244b2b80b10970bf474897'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:47.357225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b7462fc2244b2b80b10970bf474897'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:47.383337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b7462fc2244b2b80b10970bf474897'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:47.398843 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b7462fc2244b2b80b10970bf474897'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:47.398967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0b45c869-1ab2-4f43-bc22-88575d6c1226 None None] MFA Rules not processed for user `090b5fdbe72e403db95a2e8dacbef7e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:47.400504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0b45c869-1ab2-4f43-bc22-88575d6c1226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:47.401071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b7462fc2244b2b80b10970bf474897'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:47.440978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:47.449433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 845/1703] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:18:47 2022] DELETE /identity/v3/users/f5b7462fc2244b2b80b10970bf474897 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:47.603219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 859/1704] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:47.617489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:47.619181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:47.630401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d86881-5dac-4c58-bb8b-91894c030dd0 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:47.630981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d86881-5dac-4c58-bb8b-91894c030dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:47.632218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d86881-5dac-4c58-bb8b-91894c030dd0 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:47.634581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 860/1705] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jul 14 09:18:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:18:47.645291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2350c8d-fac3-4ac2-86fa-0f3e21761f8a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:47.645901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2350c8d-fac3-4ac2-86fa-0f3e21761f8a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:47.646519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2350c8d-fac3-4ac2-86fa-0f3e21761f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:47.692686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c2350c8d-fac3-4ac2-86fa-0f3e21761f8a None None] MFA Rules not processed for user `60db5d8bc4cb4ce7af8bfac2c4eb2390`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:47.696238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c2350c8d-fac3-4ac2-86fa-0f3e21761f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:47.828272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 861/1706] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:18:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:18:47.833943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2350c8d-fac3-4ac2-86fa-0f3e21761f8a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:47.836620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c2350c8d-fac3-4ac2-86fa-0f3e21761f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:47.872388 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d433fd-0c6a-4673-a628-00c1acf0f8f0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:47.888785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09047-e799-4dd8-9fff-8e46f21112b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:47.889467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09047-e799-4dd8-9fff-8e46f21112b1 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:47.890098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09047-e799-4dd8-9fff-8e46f21112b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:47.890375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09047-e799-4dd8-9fff-8e46f21112b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:48.015485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:48.032932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2350c8d-fac3-4ac2-86fa-0f3e21761f8a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:48.053257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:48.063073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:48.065624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:48.065960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] PATH_INFO: `/v3/users/0d2f6d94fa39475c9a05723d423fed4b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:48.073928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2f6d94fa39475c9a05723d423fed4b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:48.099140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:48.106410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d09047-e799-4dd8-9fff-8e46f21112b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:48.109136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d09047-e799-4dd8-9fff-8e46f21112b1 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:48.129022 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 846/1707] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:48.130323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09047-e799-4dd8-9fff-8e46f21112b1 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:48.135210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-03d09047-e799-4dd8-9fff-8e46f21112b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:48.160927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09047-e799-4dd8-9fff-8e46f21112b1 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:48.172363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015068e4-097e-4b88-aa50-ed7ec26165ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:48.173294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015068e4-097e-4b88-aa50-ed7ec26165ce service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:48.173722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015068e4-097e-4b88-aa50-ed7ec26165ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:48.178814 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015068e4-097e-4b88-aa50-ed7ec26165ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:48.210282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015068e4-097e-4b88-aa50-ed7ec26165ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:48.212155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015068e4-097e-4b88-aa50-ed7ec26165ce service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:48.215899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2f6d94fa39475c9a05723d423fed4b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:48.241689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 847/1708] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:48.242059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2f6d94fa39475c9a05723d423fed4b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:48.247559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2f6d94fa39475c9a05723d423fed4b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:48.282974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2f6d94fa39475c9a05723d423fed4b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:48.286338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2f6d94fa39475c9a05723d423fed4b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:48.303552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:48.338959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 862/1709] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:18:47 2022] DELETE /identity/v3/users/0d2f6d94fa39475c9a05723d423fed4b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:48.344011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1da7c-c08a-49e4-bff9-601c68055f7f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:48.344438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1da7c-c08a-49e4-bff9-601c68055f7f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:48.344936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1da7c-c08a-49e4-bff9-601c68055f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:48.398565 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-90e1da7c-c08a-49e4-bff9-601c68055f7f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:48.401349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-90e1da7c-c08a-49e4-bff9-601c68055f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:48.559201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 848/1710] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:48.685106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:48.687646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:48.817163 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca99364-f664-4683-961c-459a5378a2fc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:48.824163 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41f650-127e-4d5b-9d8c-bb5da163d8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:48.825024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f650-127e-4d5b-9d8c-bb5da163d8af service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:48.825333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f650-127e-4d5b-9d8c-bb5da163d8af service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:48.825692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41f650-127e-4d5b-9d8c-bb5da163d8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:48.847195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41f650-127e-4d5b-9d8c-bb5da163d8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:48.860688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41f650-127e-4d5b-9d8c-bb5da163d8af service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:48.869324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 863/1711] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:48.928644 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1da7c-c08a-49e4-bff9-601c68055f7f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:48.931071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-90e1da7c-c08a-49e4-bff9-601c68055f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:48.965746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1da7c-c08a-49e4-bff9-601c68055f7f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:48.994997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:48.996353 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:48.996648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:48.996946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] PATH_INFO: `/v3/projects/1f028505b7d14b65b02eafdf1f76942e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:49.001592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f028505b7d14b65b02eafdf1f76942e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:49.007723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:49.137687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f028505b7d14b65b02eafdf1f76942e', 'request_id': 'req-32276ef8-e3c6-496b-9cdf-f596826afe2a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:49.173896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f028505b7d14b65b02eafdf1f76942e', 'request_id': 'req-32276ef8-e3c6-496b-9cdf-f596826afe2a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:49.207529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41f650-127e-4d5b-9d8c-bb5da163d8af service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:49.210964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4a41f650-127e-4d5b-9d8c-bb5da163d8af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:49.258012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f028505b7d14b65b02eafdf1f76942e', 'request_id': 'req-32276ef8-e3c6-496b-9cdf-f596826afe2a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:49.259100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41f650-127e-4d5b-9d8c-bb5da163d8af service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:49.330259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] The token cache is being invalidate because project 1f028505b7d14b65b02eafdf1f76942e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:18:49.333906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:49.335722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32276ef8-e3c6-496b-9cdf-f596826afe2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:49.342707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 849/1712] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:18:48 2022] DELETE /identity/v3/projects/1f028505b7d14b65b02eafdf1f76942e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:49.345309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987b45-2ad3-4d6f-ac8f-6549600339f6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:49.345576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987b45-2ad3-4d6f-ac8f-6549600339f6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:49.345860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987b45-2ad3-4d6f-ac8f-6549600339f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:49.420347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1c987b45-2ad3-4d6f-ac8f-6549600339f6 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:49.426591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1c987b45-2ad3-4d6f-ac8f-6549600339f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:49.497471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:49.498331 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:49.498614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:49.498892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] PATH_INFO: `/v3/projects/7d7ff0811b90450b939387b82c6eb754` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:49.501484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7ff0811b90450b939387b82c6eb754)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:49.508176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:49.583967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:49.658980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 850/1713] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:49.667955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a849ca-1ddd-4f63-81c1-7fa1671eb9b8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:49.668245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a849ca-1ddd-4f63-81c1-7fa1671eb9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:49.668523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a849ca-1ddd-4f63-81c1-7fa1671eb9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:49.698045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7ff0811b90450b939387b82c6eb754', 'request_id': 'req-ae85e397-7d23-4145-89f5-8cbb1d108825'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:49.713880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7ff0811b90450b939387b82c6eb754', 'request_id': 'req-ae85e397-7d23-4145-89f5-8cbb1d108825'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:49.731278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7ff0811b90450b939387b82c6eb754', 'request_id': 'req-ae85e397-7d23-4145-89f5-8cbb1d108825'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:49.737822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-42a849ca-1ddd-4f63-81c1-7fa1671eb9b8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:49.738980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-42a849ca-1ddd-4f63-81c1-7fa1671eb9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:49.747807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] The token cache is being invalidate because project 7d7ff0811b90450b939387b82c6eb754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:18:49.748425 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:49.749199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ae85e397-7d23-4145-89f5-8cbb1d108825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:49.755043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 864/1714] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:18:49 2022] DELETE /identity/v3/projects/7d7ff0811b90450b939387b82c6eb754 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:49.755043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fbe0e-dbf3-4b77-94b8-b5e72b45e92f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:49.755043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fbe0e-dbf3-4b77-94b8-b5e72b45e92f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:49.755043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fbe0e-dbf3-4b77-94b8-b5e72b45e92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:49.909210 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5b9fbe0e-dbf3-4b77-94b8-b5e72b45e92f None None] MFA Rules not processed for user `d2b2f1b8064945e4834be2050db26867`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:49.913957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5b9fbe0e-dbf3-4b77-94b8-b5e72b45e92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:49.940696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:49.989707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 851/1715] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:49.992799 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1053-5918-4491-a62a-e7a3ed860c99 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:49.993203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1053-5918-4491-a62a-e7a3ed860c99 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:49.994107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1053-5918-4491-a62a-e7a3ed860c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.052968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7b6f1053-5918-4491-a62a-e7a3ed860c99 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:50.059803 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7b6f1053-5918-4491-a62a-e7a3ed860c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:50.097863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 852/1716] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:50.099105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f1053-5918-4491-a62a-e7a3ed860c99 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:50.123646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f1053-5918-4491-a62a-e7a3ed860c99 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:50.155200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c071fd-c919-490b-81d6-5324be58e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:50.156590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c071fd-c919-490b-81d6-5324be58e437 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:50.157094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c071fd-c919-490b-81d6-5324be58e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:50.157571 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c071fd-c919-490b-81d6-5324be58e437 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.158519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c071fd-c919-490b-81d6-5324be58e437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:50.159041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c071fd-c919-490b-81d6-5324be58e437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:50.160947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c071fd-c919-490b-81d6-5324be58e437 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:50.161597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 865/1717] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:50.174504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a44c-425f-4455-8985-286bd62976ab None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:50.174819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a44c-425f-4455-8985-286bd62976ab None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:50.175088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a44c-425f-4455-8985-286bd62976ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.204370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 853/1718] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:50.205997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2a865-90ab-4bf2-adb5-046510b4607f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:50.206881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2a865-90ab-4bf2-adb5-046510b4607f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:50.212377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2a865-90ab-4bf2-adb5-046510b4607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.244534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c842a44c-425f-4455-8985-286bd62976ab None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:50.245889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c842a44c-425f-4455-8985-286bd62976ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:50.258201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-cef2a865-90ab-4bf2-adb5-046510b4607f None None] MFA Rules not processed for user `d2b2f1b8064945e4834be2050db26867`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:50.267156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cef2a865-90ab-4bf2-adb5-046510b4607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:50.278406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 866/1719] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:50.279377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842a44c-425f-4455-8985-286bd62976ab None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:50.287288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 854/1720] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:50.287288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2a865-90ab-4bf2-adb5-046510b4607f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:50.311966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2a865-90ab-4bf2-adb5-046510b4607f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:50.324483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842a44c-425f-4455-8985-286bd62976ab None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:50.328609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8939e2-2f29-4ef2-9853-f1c7917a524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:50.329485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8939e2-2f29-4ef2-9853-f1c7917a524d admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:50.329841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8939e2-2f29-4ef2-9853-f1c7917a524d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:50.330207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8939e2-2f29-4ef2-9853-f1c7917a524d admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.332156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8939e2-2f29-4ef2-9853-f1c7917a524d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:50.332156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8939e2-2f29-4ef2-9853-f1c7917a524d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:50.335354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8939e2-2f29-4ef2-9853-f1c7917a524d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:50.339056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b69bc-aa11-4ccb-96e3-625719a142f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:50.339758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b69bc-aa11-4ccb-96e3-625719a142f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:50.340067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b69bc-aa11-4ccb-96e3-625719a142f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:50.340324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b69bc-aa11-4ccb-96e3-625719a142f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.341101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b69bc-aa11-4ccb-96e3-625719a142f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:50.345903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b69bc-aa11-4ccb-96e3-625719a142f2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:50.410824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 867/1721] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:50 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:50.414274 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b69bc-aa11-4ccb-96e3-625719a142f2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:50.421347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-072b69bc-aa11-4ccb-96e3-625719a142f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:50.432272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 855/1722] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:50.435845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8939e2-2f29-4ef2-9853-f1c7917a524d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:50.457245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8939e2-2f29-4ef2-9853-f1c7917a524d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:50.645435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19680e63-9600-40d5-ad9c-f84a51cb4dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:50.646159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19680e63-9600-40d5-ad9c-f84a51cb4dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:50.646450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19680e63-9600-40d5-ad9c-f84a51cb4dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:50.646723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19680e63-9600-40d5-ad9c-f84a51cb4dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.647539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19680e63-9600-40d5-ad9c-f84a51cb4dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:50.649615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19680e63-9600-40d5-ad9c-f84a51cb4dd0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:50.655861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b69bc-aa11-4ccb-96e3-625719a142f2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:50.686435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 856/1723] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:50 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:50.687370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19680e63-9600-40d5-ad9c-f84a51cb4dd0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:50.694334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406eaf6c-a189-4b6f-af23-aeee0db05386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:50.695053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eaf6c-a189-4b6f-af23-aeee0db05386 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:50.695341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eaf6c-a189-4b6f-af23-aeee0db05386 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:50.695619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eaf6c-a189-4b6f-af23-aeee0db05386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.708406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19680e63-9600-40d5-ad9c-f84a51cb4dd0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:50.736405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd744e1-6d9e-406d-9498-fb59dae1a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:50.737138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd744e1-6d9e-406d-9498-fb59dae1a899 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:50.737426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd744e1-6d9e-406d-9498-fb59dae1a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:50.737705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd744e1-6d9e-406d-9498-fb59dae1a899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.738428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd744e1-6d9e-406d-9498-fb59dae1a899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:50.748927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd744e1-6d9e-406d-9498-fb59dae1a899 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:50.819758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 857/1724] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:50 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:50.825198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd744e1-6d9e-406d-9498-fb59dae1a899 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:50.884150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:50.928193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406eaf6c-a189-4b6f-af23-aeee0db05386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:50.930155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406eaf6c-a189-4b6f-af23-aeee0db05386 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:50.944433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd744e1-6d9e-406d-9498-fb59dae1a899 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:50.949747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed31857-e77a-4e36-9457-c96fc0393fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:50.951215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed31857-e77a-4e36-9457-c96fc0393fee admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:50.952011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed31857-e77a-4e36-9457-c96fc0393fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:50.952400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed31857-e77a-4e36-9457-c96fc0393fee admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.953756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed31857-e77a-4e36-9457-c96fc0393fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:50.955481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed31857-e77a-4e36-9457-c96fc0393fee admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:50.956683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 868/1725] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:50.957858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406eaf6c-a189-4b6f-af23-aeee0db05386 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:50.974142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406eaf6c-a189-4b6f-af23-aeee0db05386 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:50.983918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42cf79-739a-4d87-af37-9a1b09df7dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:50.985191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42cf79-739a-4d87-af37-9a1b09df7dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:50.985722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42cf79-739a-4d87-af37-9a1b09df7dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:50.986199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42cf79-739a-4d87-af37-9a1b09df7dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:50.987480 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42cf79-739a-4d87-af37-9a1b09df7dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:50.989898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42cf79-739a-4d87-af37-9a1b09df7dc8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:50.995118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 858/1726] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:50.996796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e6ec-d86c-458d-a053-05272459d60d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:51.002243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e6ec-d86c-458d-a053-05272459d60d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:51.002740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e6ec-d86c-458d-a053-05272459d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:51.032696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:51.043755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 869/1727] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:50 2022] POST /identity/v3/users => generated 294 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:51.043755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2612f-7758-4aa9-a0ab-9feb0acfa927 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:51.045041 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2612f-7758-4aa9-a0ab-9feb0acfa927 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:51.045866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2612f-7758-4aa9-a0ab-9feb0acfa927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:51.127805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-75c5e6ec-d86c-458d-a053-05272459d60d None None] MFA Rules not processed for user `0bea4c8d195145a29eefee98e4b9ef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:51.129300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-75c5e6ec-d86c-458d-a053-05272459d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:51.208415 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-aff2612f-7758-4aa9-a0ab-9feb0acfa927 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:51.209457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-aff2612f-7758-4aa9-a0ab-9feb0acfa927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:51.215620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 859/1728] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:51.227786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5e6ec-d86c-458d-a053-05272459d60d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:51.241354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5e6ec-d86c-458d-a053-05272459d60d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:51.247241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a584be-df3d-4ca9-9de2-89a4821f4762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:51.248092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a584be-df3d-4ca9-9de2-89a4821f4762 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:51.248474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a584be-df3d-4ca9-9de2-89a4821f4762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:51.248891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a584be-df3d-4ca9-9de2-89a4821f4762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:51.249869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a584be-df3d-4ca9-9de2-89a4821f4762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:51.252074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a584be-df3d-4ca9-9de2-89a4821f4762 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:51.265452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 860/1729] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:51.266864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a584be-df3d-4ca9-9de2-89a4821f4762 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:51.278253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a584be-df3d-4ca9-9de2-89a4821f4762 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:51.283301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee57cd6-5f87-42ac-90b3-2c79d1081233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:51.284115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee57cd6-5f87-42ac-90b3-2c79d1081233 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:51.284643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee57cd6-5f87-42ac-90b3-2c79d1081233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:51.285062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee57cd6-5f87-42ac-90b3-2c79d1081233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:51.286302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee57cd6-5f87-42ac-90b3-2c79d1081233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:51.288750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee57cd6-5f87-42ac-90b3-2c79d1081233 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:51.301182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 861/1730] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:51.302217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee57cd6-5f87-42ac-90b3-2c79d1081233 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:51.305186 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2ee57cd6-5f87-42ac-90b3-2c79d1081233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:51.321094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee57cd6-5f87-42ac-90b3-2c79d1081233 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:51.327135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:51.328425 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:51.328936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:51.329315 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] PATH_INFO: `/v3/projects/2dffbe34dfba4632bb43052cba029837` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:51.330729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dffbe34dfba4632bb43052cba029837)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:51.332859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:51.364223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 870/1731] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:18:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:51.368546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2612f-7758-4aa9-a0ab-9feb0acfa927 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:51.416893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2612f-7758-4aa9-a0ab-9feb0acfa927 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:51.419671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dffbe34dfba4632bb43052cba029837', 'request_id': 'req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:51.429527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dffbe34dfba4632bb43052cba029837', 'request_id': 'req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:51.447095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dffbe34dfba4632bb43052cba029837', 'request_id': 'req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:51.473901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] The token cache is being invalidate because project 2dffbe34dfba4632bb43052cba029837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:18:51.474193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:51.480648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:51.486872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 862/1732] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:18:51 2022] DELETE /identity/v3/projects/2dffbe34dfba4632bb43052cba029837 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:51.487917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:51.493086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:51.503795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:51.577424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccee6f-31b7-448b-8ed8-8da36afb17fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:51.578731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccee6f-31b7-448b-8ed8-8da36afb17fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:51.578731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccee6f-31b7-448b-8ed8-8da36afb17fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:51.578919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccee6f-31b7-448b-8ed8-8da36afb17fb admin admin] PATH_INFO: `/v3/projects/9b1995968b1848f4bbb95c384c8e3076/users/8394225dc2654093b57bfce328664afb/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:51.611920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccee6f-31b7-448b-8ed8-8da36afb17fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1995968b1848f4bbb95c384c8e3076, user_id=8394225dc2654093b57bfce328664afb, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:51.615701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccee6f-31b7-448b-8ed8-8da36afb17fb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:51.649508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c06b2-98df-42b5-bbb1-ad1fafc5e768 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:51.651234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 871/1733] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:51 2022] PUT /identity/v3/projects/9b1995968b1848f4bbb95c384c8e3076/users/8394225dc2654093b57bfce328664afb/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:51.662429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccee6f-31b7-448b-8ed8-8da36afb17fb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:51.665294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-19ccee6f-31b7-448b-8ed8-8da36afb17fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:51.798915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:51.806186 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c619421-1df3-4de6-96ff-b1d6e98f76da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:51.808852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c619421-1df3-4de6-96ff-b1d6e98f76da admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:51.809154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c619421-1df3-4de6-96ff-b1d6e98f76da admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:51.809728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c619421-1df3-4de6-96ff-b1d6e98f76da admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:51.810946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c619421-1df3-4de6-96ff-b1d6e98f76da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:51.813106 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c619421-1df3-4de6-96ff-b1d6e98f76da admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:51.817144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccee6f-31b7-448b-8ed8-8da36afb17fb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:51.829966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:51.832752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:51.833342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:51.834121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] PATH_INFO: `/v3/users/6a307ce43e1240f2a141e1cf4315f19c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:51.838003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a307ce43e1240f2a141e1cf4315f19c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:51.842309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 863/1734] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:51.843513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:51.843617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c619421-1df3-4de6-96ff-b1d6e98f76da admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:51.846054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0c619421-1df3-4de6-96ff-b1d6e98f76da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:51.988058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a307ce43e1240f2a141e1cf4315f19c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:51.995918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a307ce43e1240f2a141e1cf4315f19c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:51.996908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a307ce43e1240f2a141e1cf4315f19c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:52.009588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a307ce43e1240f2a141e1cf4315f19c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:52.010523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-28669cc9-3a0d-4aec-91c9-a3fe3dd69039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a307ce43e1240f2a141e1cf4315f19c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:52.053034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 872/1735] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:18:51 2022] DELETE /identity/v3/users/6a307ce43e1240f2a141e1cf4315f19c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:52.056734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78041862-3e6a-43f7-9267-bb7fa3db9780 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:52.057204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78041862-3e6a-43f7-9267-bb7fa3db9780 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:52.058071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78041862-3e6a-43f7-9267-bb7fa3db9780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:52.101990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c619421-1df3-4de6-96ff-b1d6e98f76da admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:52.133773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-78041862-3e6a-43f7-9267-bb7fa3db9780 None None] MFA Rules not processed for user `8394225dc2654093b57bfce328664afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:52.135987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-78041862-3e6a-43f7-9267-bb7fa3db9780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:52.178898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:52.241415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3a159-5d23-450e-9f80-f67568c7bc80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:52.242294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3a159-5d23-450e-9f80-f67568c7bc80 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:52.242612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3a159-5d23-450e-9f80-f67568c7bc80 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:52.243003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3a159-5d23-450e-9f80-f67568c7bc80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:52.245081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-48c3a159-5d23-450e-9f80-f67568c7bc80 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:52.311538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 873/1736] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:52.312623 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78041862-3e6a-43f7-9267-bb7fa3db9780 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:52.317843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-78041862-3e6a-43f7-9267-bb7fa3db9780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:52.335516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3a159-5d23-450e-9f80-f67568c7bc80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:52.337635 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3a159-5d23-450e-9f80-f67568c7bc80 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:52.352570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 864/1737] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:18:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:18:52.353692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3a159-5d23-450e-9f80-f67568c7bc80 service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:52.355686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-48c3a159-5d23-450e-9f80-f67568c7bc80 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:52.490406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78041862-3e6a-43f7-9267-bb7fa3db9780 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:52.495493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbad8c-dfef-428b-b3a2-030bf9743099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:52.496526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbad8c-dfef-428b-b3a2-030bf9743099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:52.496830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbad8c-dfef-428b-b3a2-030bf9743099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:52.497104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbad8c-dfef-428b-b3a2-030bf9743099 admin admin] PATH_INFO: `/v3/projects/47c7d99223ee4b9496c36c84e7afa95f/users/063520702dcc4ffaad035d158d5d879d/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:52.513405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3a159-5d23-450e-9f80-f67568c7bc80 service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:52.513890 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:52.536856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5474b-4fd8-4394-b6f3-bfaffd896963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:52.537097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbad8c-dfef-428b-b3a2-030bf9743099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c7d99223ee4b9496c36c84e7afa95f, user_id=063520702dcc4ffaad035d158d5d879d, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:52.537549 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5474b-4fd8-4394-b6f3-bfaffd896963 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:52.537837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5474b-4fd8-4394-b6f3-bfaffd896963 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:52.538114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5474b-4fd8-4394-b6f3-bfaffd896963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:52.540029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbad8c-dfef-428b-b3a2-030bf9743099 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:52.543454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-10a5474b-4fd8-4394-b6f3-bfaffd896963 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:52.597863 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 874/1738] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:52 2022] PUT /identity/v3/projects/47c7d99223ee4b9496c36c84e7afa95f/users/063520702dcc4ffaad035d158d5d879d/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:52.612920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbad8c-dfef-428b-b3a2-030bf9743099 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:52.623351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a8fbad8c-dfef-428b-b3a2-030bf9743099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:52.721213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5474b-4fd8-4394-b6f3-bfaffd896963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:52.722851 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5474b-4fd8-4394-b6f3-bfaffd896963 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:52.748704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 865/1739] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:52.771636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992a712-c7dd-43e2-9026-c8b7c3beba5d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:52.771944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992a712-c7dd-43e2-9026-c8b7c3beba5d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:52.772224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992a712-c7dd-43e2-9026-c8b7c3beba5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:52.833436 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:52.841436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbad8c-dfef-428b-b3a2-030bf9743099 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:52.857311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab4e29-b975-4bc7-8fd2-1fd28b99ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:52.860512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab4e29-b975-4bc7-8fd2-1fd28b99ec72 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:52.861722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab4e29-b975-4bc7-8fd2-1fd28b99ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:52.862185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab4e29-b975-4bc7-8fd2-1fd28b99ec72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:52.865510 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab4e29-b975-4bc7-8fd2-1fd28b99ec72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:52.871336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab4e29-b975-4bc7-8fd2-1fd28b99ec72 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:52.916559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a992a712-c7dd-43e2-9026-c8b7c3beba5d None None] MFA Rules not processed for user `063520702dcc4ffaad035d158d5d879d`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:52.919412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a992a712-c7dd-43e2-9026-c8b7c3beba5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:52.936948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 875/1740] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:52 2022] POST /identity/v3/projects => generated 369 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:52.938308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab4e29-b975-4bc7-8fd2-1fd28b99ec72 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:53.142782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 866/1741] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:53.146472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992a712-c7dd-43e2-9026-c8b7c3beba5d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:53.183868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab4e29-b975-4bc7-8fd2-1fd28b99ec72 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:53.195213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992a712-c7dd-43e2-9026-c8b7c3beba5d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:53.203046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0b454-7d72-401a-801f-8df639e4f3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:53.203747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b454-7d72-401a-801f-8df639e4f3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:53.204036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b454-7d72-401a-801f-8df639e4f3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:53.204321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b454-7d72-401a-801f-8df639e4f3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:53.204440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e6d05-e92d-4dfa-8369-af346a8fece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:53.212740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0b454-7d72-401a-801f-8df639e4f3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:53.213055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6d05-e92d-4dfa-8369-af346a8fece1 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:53.213055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6d05-e92d-4dfa-8369-af346a8fece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:53.213055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6d05-e92d-4dfa-8369-af346a8fece1 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:53.213273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0b454-7d72-401a-801f-8df639e4f3aa admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:53.217089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e6d05-e92d-4dfa-8369-af346a8fece1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:53.223895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e6d05-e92d-4dfa-8369-af346a8fece1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:53.286040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 876/1742] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:52 2022] POST /identity/v3/users => generated 291 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:53.291318 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e6d05-e92d-4dfa-8369-af346a8fece1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:53.303377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 867/1743] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:53 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:53.315811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0b454-7d72-401a-801f-8df639e4f3aa admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:53.331655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e6d05-e92d-4dfa-8369-af346a8fece1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:53.546175 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0b454-7d72-401a-801f-8df639e4f3aa admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:53.563661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be36b7-24a7-4792-a2e3-7db1a59aca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:53.564376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be36b7-24a7-4792-a2e3-7db1a59aca95 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:53.564680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be36b7-24a7-4792-a2e3-7db1a59aca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:53.565012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be36b7-24a7-4792-a2e3-7db1a59aca95 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:53.565728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be36b7-24a7-4792-a2e3-7db1a59aca95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:53.567669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be36b7-24a7-4792-a2e3-7db1a59aca95 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:53.569378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8ef2b-80f0-48a4-8a4d-e7d5496ba672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:53.571949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8ef2b-80f0-48a4-8a4d-e7d5496ba672 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:53.572241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8ef2b-80f0-48a4-8a4d-e7d5496ba672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:53.572520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8ef2b-80f0-48a4-8a4d-e7d5496ba672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:53.573612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8ef2b-80f0-48a4-8a4d-e7d5496ba672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:53.575407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8ef2b-80f0-48a4-8a4d-e7d5496ba672 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:53.578395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:53.595505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 877/1744] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:53.600097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8ef2b-80f0-48a4-8a4d-e7d5496ba672 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:53.620780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 868/1745] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:53 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:53.623448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8ef2b-80f0-48a4-8a4d-e7d5496ba672 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:53.625267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be36b7-24a7-4792-a2e3-7db1a59aca95 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:53.629752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d4c2-5d9a-4438-baec-156a22324a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:53.630684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d4c2-5d9a-4438-baec-156a22324a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:53.630966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d4c2-5d9a-4438-baec-156a22324a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:53.631240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d4c2-5d9a-4438-baec-156a22324a80 admin admin] PATH_INFO: `/v3/projects/282d7effad2142d6af05b1edac9de5e0/users/c8d6f16b2a09457680fdfdbdd2c9109f/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:53.651408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be36b7-24a7-4792-a2e3-7db1a59aca95 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:53.662434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d887a-a67b-4dd6-a804-65554f8d4f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:53.663153 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d887a-a67b-4dd6-a804-65554f8d4f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:53.663446 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d887a-a67b-4dd6-a804-65554f8d4f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:53.663758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d887a-a67b-4dd6-a804-65554f8d4f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:53.664605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d887a-a67b-4dd6-a804-65554f8d4f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:53.666294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d887a-a67b-4dd6-a804-65554f8d4f7a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:53.668894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d4c2-5d9a-4438-baec-156a22324a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282d7effad2142d6af05b1edac9de5e0, user_id=c8d6f16b2a09457680fdfdbdd2c9109f, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:53.672938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d4c2-5d9a-4438-baec-156a22324a80 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:53.692061 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 869/1746] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:53.696024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d887a-a67b-4dd6-a804-65554f8d4f7a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:53.699916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 878/1747] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:53 2022] PUT /identity/v3/projects/282d7effad2142d6af05b1edac9de5e0/users/c8d6f16b2a09457680fdfdbdd2c9109f/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:53.704426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d4c2-5d9a-4438-baec-156a22324a80 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:53.718720 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d887a-a67b-4dd6-a804-65554f8d4f7a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:53.830256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:53.852756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691094-8933-41e6-ad6f-1705aa944bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:53.853491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691094-8933-41e6-ad6f-1705aa944bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:53.859942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691094-8933-41e6-ad6f-1705aa944bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:53.859942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691094-8933-41e6-ad6f-1705aa944bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:53.859942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80691094-8933-41e6-ad6f-1705aa944bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:53.869076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80691094-8933-41e6-ad6f-1705aa944bb3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:53.902260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 870/1748] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:53.912461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691094-8933-41e6-ad6f-1705aa944bb3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:53.942053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691094-8933-41e6-ad6f-1705aa944bb3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:53.952898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b95c2-ed82-472a-a5b1-c060613d4abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:53.953716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b95c2-ed82-472a-a5b1-c060613d4abb admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:53.954214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b95c2-ed82-472a-a5b1-c060613d4abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:53.954363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b95c2-ed82-472a-a5b1-c060613d4abb admin admin] PATH_INFO: `/v3/projects/054459fd2f7c4aac856c9c122877b333/users/1ed31f0d659245359621bf27948c39b8/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:53.976045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d4c2-5d9a-4438-baec-156a22324a80 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:53.983571 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b95c2-ed82-472a-a5b1-c060613d4abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=054459fd2f7c4aac856c9c122877b333, user_id=1ed31f0d659245359621bf27948c39b8, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:53.986856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b95c2-ed82-472a-a5b1-c060613d4abb admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:53.998000 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41383a39-e6a3-44d2-bf44-bd2a83832bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:53.998907 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41383a39-e6a3-44d2-bf44-bd2a83832bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:53.999330 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41383a39-e6a3-44d2-bf44-bd2a83832bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:53.999765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41383a39-e6a3-44d2-bf44-bd2a83832bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:54.000886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41383a39-e6a3-44d2-bf44-bd2a83832bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:54.002978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41383a39-e6a3-44d2-bf44-bd2a83832bbf admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:54.012056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 871/1749] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:53 2022] PUT /identity/v3/projects/054459fd2f7c4aac856c9c122877b333/users/1ed31f0d659245359621bf27948c39b8/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:54.024783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627a769-24dc-4dd3-ad50-8c3d03306ee2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:54.025887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627a769-24dc-4dd3-ad50-8c3d03306ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:54.026272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627a769-24dc-4dd3-ad50-8c3d03306ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:54.033813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 879/1750] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:54.036759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41383a39-e6a3-44d2-bf44-bd2a83832bbf admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:54.067041 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41383a39-e6a3-44d2-bf44-bd2a83832bbf admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:54.080242 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7627a769-24dc-4dd3-ad50-8c3d03306ee2 None None] MFA Rules not processed for user `1ed31f0d659245359621bf27948c39b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:54.082078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7627a769-24dc-4dd3-ad50-8c3d03306ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:54.232558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee8d94-2c18-4a1a-a2a4-2dc1dcf24284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:54.238361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee8d94-2c18-4a1a-a2a4-2dc1dcf24284 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:54.238854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee8d94-2c18-4a1a-a2a4-2dc1dcf24284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:54.239327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee8d94-2c18-4a1a-a2a4-2dc1dcf24284 admin admin] PATH_INFO: `/v3/projects/282d7effad2142d6af05b1edac9de5e0/users/c8d6f16b2a09457680fdfdbdd2c9109f/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:54.242781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee8d94-2c18-4a1a-a2a4-2dc1dcf24284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282d7effad2142d6af05b1edac9de5e0, user_id=c8d6f16b2a09457680fdfdbdd2c9109f, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:54.255841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee8d94-2c18-4a1a-a2a4-2dc1dcf24284 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:54.269309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 872/1751] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:54.273435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627a769-24dc-4dd3-ad50-8c3d03306ee2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:54.292879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627a769-24dc-4dd3-ad50-8c3d03306ee2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:54.304281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 880/1752] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:54 2022] PUT /identity/v3/projects/282d7effad2142d6af05b1edac9de5e0/users/c8d6f16b2a09457680fdfdbdd2c9109f/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:54.307535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5350-d07d-447f-87b4-c189893dc762 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:54.308132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5350-d07d-447f-87b4-c189893dc762 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:54.308612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5350-d07d-447f-87b4-c189893dc762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:54.395958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-dfad5350-d07d-447f-87b4-c189893dc762 None None] MFA Rules not processed for user `c8d6f16b2a09457680fdfdbdd2c9109f`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:54.397864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-dfad5350-d07d-447f-87b4-c189893dc762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:54.516010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1955170-8728-40af-a6a0-4a2cc32fd5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:54.516476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955170-8728-40af-a6a0-4a2cc32fd5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:54.516646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955170-8728-40af-a6a0-4a2cc32fd5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:54.518361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955170-8728-40af-a6a0-4a2cc32fd5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:54.519123 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1955170-8728-40af-a6a0-4a2cc32fd5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:54.527941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1955170-8728-40af-a6a0-4a2cc32fd5f4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:54.543190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:54.605659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 873/1753] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:54 2022] POST /identity/v3/projects => generated 387 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:18:54.607281 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1955170-8728-40af-a6a0-4a2cc32fd5f4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:54.620195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 881/1754] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:54.633996 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5350-d07d-447f-87b4-c189893dc762 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:54.638016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-dfad5350-d07d-447f-87b4-c189893dc762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:54.818836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:54.867028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1955170-8728-40af-a6a0-4a2cc32fd5f4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:54.874370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baa475-6c61-44c8-9ccb-3cbc0d0e3bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:54.875080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa475-6c61-44c8-9ccb-3cbc0d0e3bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:54.875530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa475-6c61-44c8-9ccb-3cbc0d0e3bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:54.875939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa475-6c61-44c8-9ccb-3cbc0d0e3bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:54.876679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5350-d07d-447f-87b4-c189893dc762 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:54.877402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baa475-6c61-44c8-9ccb-3cbc0d0e3bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:54.881512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baa475-6c61-44c8-9ccb-3cbc0d0e3bd4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:54.946684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 874/1755] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:54 2022] POST /identity/v3/users => generated 300 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:54.948924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fc92e-aa58-4d3d-8dc6-38815cc785a3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:54.949248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fc92e-aa58-4d3d-8dc6-38815cc785a3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:54.949572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fc92e-aa58-4d3d-8dc6-38815cc785a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:55.030385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-702fc92e-aa58-4d3d-8dc6-38815cc785a3 None None] MFA Rules not processed for user `60db5d8bc4cb4ce7af8bfac2c4eb2390`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:55.034296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-702fc92e-aa58-4d3d-8dc6-38815cc785a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:55.069500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d522ff2-fed0-467f-aaab-4cbac4c2365b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:55.070552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d522ff2-fed0-467f-aaab-4cbac4c2365b service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:55.070952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d522ff2-fed0-467f-aaab-4cbac4c2365b service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:55.071339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d522ff2-fed0-467f-aaab-4cbac4c2365b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:55.243317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 875/1756] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jul 14 09:18:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:55.245495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fc92e-aa58-4d3d-8dc6-38815cc785a3 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:55.263840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d522ff2-fed0-467f-aaab-4cbac4c2365b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:55.269013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d522ff2-fed0-467f-aaab-4cbac4c2365b service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:55.314241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fc92e-aa58-4d3d-8dc6-38815cc785a3 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:55.333274 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 882/1757] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:55.335045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c53318-2694-4aae-8513-1c1afcd89ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:55.335849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53318-2694-4aae-8513-1c1afcd89ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:55.336209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53318-2694-4aae-8513-1c1afcd89ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:55.336461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53318-2694-4aae-8513-1c1afcd89ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:55.337258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c53318-2694-4aae-8513-1c1afcd89ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:55.342662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c53318-2694-4aae-8513-1c1afcd89ff0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:55.399649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d522ff2-fed0-467f-aaab-4cbac4c2365b service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:55.407669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 876/1758] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:55.411396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c53318-2694-4aae-8513-1c1afcd89ff0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:55.414177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d522ff2-fed0-467f-aaab-4cbac4c2365b service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:55.415908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b0c53318-2694-4aae-8513-1c1afcd89ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:55.429483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfababc3-4566-4298-94f2-f8c8a4f1f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:55.430827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfababc3-4566-4298-94f2-f8c8a4f1f344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:55.431303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfababc3-4566-4298-94f2-f8c8a4f1f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:55.431720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfababc3-4566-4298-94f2-f8c8a4f1f344 admin admin] PATH_INFO: `/v3/projects/21bcdde457fe4c94ab8ab2bd688542f7/users/a0fa04a897bf4545b39a7082657fcfd6/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:55.454150 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfababc3-4566-4298-94f2-f8c8a4f1f344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bcdde457fe4c94ab8ab2bd688542f7, user_id=a0fa04a897bf4545b39a7082657fcfd6, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:55.458125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfababc3-4566-4298-94f2-f8c8a4f1f344 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:55.459589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c53318-2694-4aae-8513-1c1afcd89ff0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:55.475537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 883/1759] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:55 2022] PUT /identity/v3/projects/21bcdde457fe4c94ab8ab2bd688542f7/users/a0fa04a897bf4545b39a7082657fcfd6/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:55.484163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a2d00-0722-44e3-a810-efc0545e56c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:55.485697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a2d00-0722-44e3-a810-efc0545e56c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:55.486015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a2d00-0722-44e3-a810-efc0545e56c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:55.486271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a2d00-0722-44e3-a810-efc0545e56c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:55.529168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfababc3-4566-4298-94f2-f8c8a4f1f344 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:55.677988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a2d00-0722-44e3-a810-efc0545e56c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:55.679525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a2d00-0722-44e3-a810-efc0545e56c6 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:55.701608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:55.705761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 877/1760] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:55.796882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a2d00-0722-44e3-a810-efc0545e56c6 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:55.798402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-523a2d00-0722-44e3-a810-efc0545e56c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:55.809373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfababc3-4566-4298-94f2-f8c8a4f1f344 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:55.822128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a2d00-0722-44e3-a810-efc0545e56c6 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:55.824267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2193b7-9b15-4957-977a-d39b591a796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:55.825127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2193b7-9b15-4957-977a-d39b591a796c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:55.825513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2193b7-9b15-4957-977a-d39b591a796c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:55.832618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2193b7-9b15-4957-977a-d39b591a796c admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:55.833537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2193b7-9b15-4957-977a-d39b591a796c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:55.846425 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2193b7-9b15-4957-977a-d39b591a796c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:55.875999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 884/1761] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:55.880226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2193b7-9b15-4957-977a-d39b591a796c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:55.904624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2193b7-9b15-4957-977a-d39b591a796c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:55.923291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4129ab-b487-4565-ae9f-26226b554c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:55.925879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4129ab-b487-4565-ae9f-26226b554c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:55.927651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4129ab-b487-4565-ae9f-26226b554c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:55.928956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4129ab-b487-4565-ae9f-26226b554c71 admin admin] PATH_INFO: `/v3/projects/21bcdde457fe4c94ab8ab2bd688542f7/users/a0fa04a897bf4545b39a7082657fcfd6/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:55.933839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4129ab-b487-4565-ae9f-26226b554c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bcdde457fe4c94ab8ab2bd688542f7, user_id=a0fa04a897bf4545b39a7082657fcfd6, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:55.940170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4129ab-b487-4565-ae9f-26226b554c71 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:55.987482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 885/1762] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:55 2022] PUT /identity/v3/projects/21bcdde457fe4c94ab8ab2bd688542f7/users/a0fa04a897bf4545b39a7082657fcfd6/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:18:55.987482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4129ab-b487-4565-ae9f-26226b554c71 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:55.990504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4c4129ab-b487-4565-ae9f-26226b554c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:56.010614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4546263-913d-4f13-a177-c165c107f9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:56.011304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546263-913d-4f13-a177-c165c107f9ac service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:56.011594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546263-913d-4f13-a177-c165c107f9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:56.011874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546263-913d-4f13-a177-c165c107f9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:56.053126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4546263-913d-4f13-a177-c165c107f9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:56.061154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4546263-913d-4f13-a177-c165c107f9ac service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:56.141938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 878/1763] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:18:56.144516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0818c7-d622-40a3-b48e-283408eadafc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:56.151133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0818c7-d622-40a3-b48e-283408eadafc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:56.151589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0818c7-d622-40a3-b48e-283408eadafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:56.236594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:56.281980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1b0818c7-d622-40a3-b48e-283408eadafc None None] MFA Rules not processed for user `a0fa04a897bf4545b39a7082657fcfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:56.287784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1b0818c7-d622-40a3-b48e-283408eadafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:56.375837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4129ab-b487-4565-ae9f-26226b554c71 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:56.401921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:56.414121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:56.417233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:56.417671 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] PATH_INFO: `/v3/projects/0e19010f4ca549d78a670b3f428733fc` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:56.421486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e19010f4ca549d78a670b3f428733fc)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:56.433927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:56.681549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e19010f4ca549d78a670b3f428733fc', 'request_id': 'req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:56.718107 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e19010f4ca549d78a670b3f428733fc', 'request_id': 'req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:56.764157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 879/1764] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:56.765936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c031c-9d56-4e3e-b0fa-2c840f3be4f8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:56.766473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c031c-9d56-4e3e-b0fa-2c840f3be4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:56.766473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c031c-9d56-4e3e-b0fa-2c840f3be4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:56.773072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e19010f4ca549d78a670b3f428733fc', 'request_id': 'req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:56.830253 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] The token cache is being invalidate because project 0e19010f4ca549d78a670b3f428733fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:18:56.836375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:56.838844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-44cdb41b-b233-496e-bcb8-f54d08c1f3cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:18:56.841681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 886/1765] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:18:55 2022] DELETE /identity/v3/projects/0e19010f4ca549d78a670b3f428733fc => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:56.850935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7fbb-d690-460e-8f62-b3fa442d21d4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:56.859829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7fbb-d690-460e-8f62-b3fa442d21d4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:56.860377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f7fbb-d690-460e-8f62-b3fa442d21d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:56.876045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-cb2c031c-9d56-4e3e-b0fa-2c840f3be4f8 None None] MFA Rules not processed for user `d2b2f1b8064945e4834be2050db26867`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:56.877630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cb2c031c-9d56-4e3e-b0fa-2c840f3be4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:56.954866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-832f7fbb-d690-460e-8f62-b3fa442d21d4 None None] MFA Rules not processed for user `090b5fdbe72e403db95a2e8dacbef7e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:56.963348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-832f7fbb-d690-460e-8f62-b3fa442d21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:57.118780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:57.215379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 880/1766] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:57.220796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c031c-9d56-4e3e-b0fa-2c840f3be4f8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:57.224616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 887/1767] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:57.226861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cb2c031c-9d56-4e3e-b0fa-2c840f3be4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:57.234287 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6831b-fec7-4101-a178-3e6415ca0a1c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:57.239836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6831b-fec7-4101-a178-3e6415ca0a1c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:57.241917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6831b-fec7-4101-a178-3e6415ca0a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:57.322066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-45a6831b-fec7-4101-a178-3e6415ca0a1c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:57.323419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-45a6831b-fec7-4101-a178-3e6415ca0a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:57.455358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c031c-9d56-4e3e-b0fa-2c840f3be4f8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:57.472981 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb27da-d003-45af-b3fc-763cc3f19631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:57.474600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb27da-d003-45af-b3fc-763cc3f19631 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:57.474934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb27da-d003-45af-b3fc-763cc3f19631 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:57.475308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb27da-d003-45af-b3fc-763cc3f19631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:57.493616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-63cb27da-d003-45af-b3fc-763cc3f19631 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:57.597763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 888/1768] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:57.604791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596862ba-2b09-4d73-82ef-6ec439cb2590 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:57.605780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596862ba-2b09-4d73-82ef-6ec439cb2590 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:57.606332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596862ba-2b09-4d73-82ef-6ec439cb2590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:57.647162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-596862ba-2b09-4d73-82ef-6ec439cb2590 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:57.656640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-596862ba-2b09-4d73-82ef-6ec439cb2590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:57.696642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 889/1769] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:18:57.712447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596862ba-2b09-4d73-82ef-6ec439cb2590 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:57.725106 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:57.744174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596862ba-2b09-4d73-82ef-6ec439cb2590 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:57.767932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb27da-d003-45af-b3fc-763cc3f19631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:57.769448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb27da-d003-45af-b3fc-763cc3f19631 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:57.769860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f7687-4024-4d5a-937e-a9256f018974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:57.770562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f7687-4024-4d5a-937e-a9256f018974 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:57.770852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f7687-4024-4d5a-937e-a9256f018974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:57.771127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f7687-4024-4d5a-937e-a9256f018974 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:57.771875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f7687-4024-4d5a-937e-a9256f018974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:18:57.772184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f7687-4024-4d5a-937e-a9256f018974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:57.774242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f7687-4024-4d5a-937e-a9256f018974 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:57.822836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 890/1770] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:18:57.823803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f7687-4024-4d5a-937e-a9256f018974 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:57.829684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 881/1771] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:18:57.861361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f7687-4024-4d5a-937e-a9256f018974 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:57.907621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e38c1b-112c-4b5b-a694-15595729eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:57.908343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e38c1b-112c-4b5b-a694-15595729eeaf admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:57.908587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e38c1b-112c-4b5b-a694-15595729eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:57.908891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e38c1b-112c-4b5b-a694-15595729eeaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:57.925430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e38c1b-112c-4b5b-a694-15595729eeaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:57.943077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e38c1b-112c-4b5b-a694-15595729eeaf admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:58.083408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 891/1772] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:57 2022] POST /identity/v3/projects => generated 365 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:58.087436 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb27da-d003-45af-b3fc-763cc3f19631 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:58.112386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb27da-d003-45af-b3fc-763cc3f19631 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:58.415900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488c61b-555c-468e-9205-4b5de41022e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:58.419281 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c61b-555c-468e-9205-4b5de41022e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:58.419638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c61b-555c-468e-9205-4b5de41022e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:58.423708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c61b-555c-468e-9205-4b5de41022e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:58.424596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488c61b-555c-468e-9205-4b5de41022e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:58.428883 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488c61b-555c-468e-9205-4b5de41022e1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:58.507203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 882/1773] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:58 2022] POST /identity/v3/users => generated 283 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:58.511668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e38c1b-112c-4b5b-a694-15595729eeaf admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:58.537547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e38c1b-112c-4b5b-a694-15595729eeaf admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:58.564628 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b111-5d5f-4c45-ba6c-f629166f6bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:58.566075 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b111-5d5f-4c45-ba6c-f629166f6bed admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:58.566361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b111-5d5f-4c45-ba6c-f629166f6bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:58.571197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b111-5d5f-4c45-ba6c-f629166f6bed admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:58.572685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1b111-5d5f-4c45-ba6c-f629166f6bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:58.579556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1b111-5d5f-4c45-ba6c-f629166f6bed admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:58.638737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 892/1774] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:58.641750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488c61b-555c-468e-9205-4b5de41022e1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:58.677288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488c61b-555c-468e-9205-4b5de41022e1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:58.691687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0334f6-225e-4f1f-8174-b1581820f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:58.692426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0334f6-225e-4f1f-8174-b1581820f669 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:58.697027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0334f6-225e-4f1f-8174-b1581820f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:58.697443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0334f6-225e-4f1f-8174-b1581820f669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:58.698355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0334f6-225e-4f1f-8174-b1581820f669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:58.702860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0334f6-225e-4f1f-8174-b1581820f669 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:58.743539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 883/1775] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:18:58.745284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b111-5d5f-4c45-ba6c-f629166f6bed admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:58.758161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b111-5d5f-4c45-ba6c-f629166f6bed admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:58.765086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aed4ea-a230-48db-9c5c-efcd67cd0480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:58.766659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aed4ea-a230-48db-9c5c-efcd67cd0480 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:58.767157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aed4ea-a230-48db-9c5c-efcd67cd0480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:58.767806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aed4ea-a230-48db-9c5c-efcd67cd0480 admin admin] PATH_INFO: `/v3/projects/4122e326acd446409d9502cb3e3a6253/users/e84f8a8c34eb4ee5b1dd406743f3f4e6/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:58.790240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aed4ea-a230-48db-9c5c-efcd67cd0480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4122e326acd446409d9502cb3e3a6253, user_id=e84f8a8c34eb4ee5b1dd406743f3f4e6, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:58.793269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aed4ea-a230-48db-9c5c-efcd67cd0480 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:58.822356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 893/1776] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:18:58 2022] PUT /identity/v3/projects/4122e326acd446409d9502cb3e3a6253/users/e84f8a8c34eb4ee5b1dd406743f3f4e6/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:18:58.831746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f02f3-0e0d-4a8d-a217-81963ea93ba6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:58.832750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f02f3-0e0d-4a8d-a217-81963ea93ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:58.833225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f02f3-0e0d-4a8d-a217-81963ea93ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:58.886532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f05f02f3-0e0d-4a8d-a217-81963ea93ba6 None None] MFA Rules not processed for user `e84f8a8c34eb4ee5b1dd406743f3f4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:18:58.889408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f05f02f3-0e0d-4a8d-a217-81963ea93ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:59.075784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 884/1777] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:18:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:18:59.080308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aed4ea-a230-48db-9c5c-efcd67cd0480 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:59.397732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aed4ea-a230-48db-9c5c-efcd67cd0480 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:59.427984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0b6b4-2dc8-41b5-bc85-ff08c59261d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:59.431566 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b6b4-2dc8-41b5-bc85-ff08c59261d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:59.432326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b6b4-2dc8-41b5-bc85-ff08c59261d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:59.432859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b6b4-2dc8-41b5-bc85-ff08c59261d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:59.435916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0b6b4-2dc8-41b5-bc85-ff08c59261d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:59.459028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0b6b4-2dc8-41b5-bc85-ff08c59261d2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:59.566004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:59.582377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 894/1778] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:18:59 2022] POST /identity/v3/projects => generated 363 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:59.589901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f02f3-0e0d-4a8d-a217-81963ea93ba6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:59.620391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f02f3-0e0d-4a8d-a217-81963ea93ba6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:18:59.831784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:18:59.852551 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146e8e-06e5-4551-9138-d27d6f33ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:18:59.854089 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146e8e-06e5-4551-9138-d27d6f33ad8e admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:18:59.854824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146e8e-06e5-4551-9138-d27d6f33ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:18:59.855365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146e8e-06e5-4551-9138-d27d6f33ad8e admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:18:59.891760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae146e8e-06e5-4551-9138-d27d6f33ad8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:18:59.900361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae146e8e-06e5-4551-9138-d27d6f33ad8e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:18:59.923152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0b6b4-2dc8-41b5-bc85-ff08c59261d2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:18:59.928615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ddf0b6b4-2dc8-41b5-bc85-ff08c59261d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:18:59.977137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 885/1779] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:18:59 2022] POST /identity/v3/users => generated 288 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:18:59.980145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146e8e-06e5-4551-9138-d27d6f33ad8e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:00.030691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146e8e-06e5-4551-9138-d27d6f33ad8e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:00.061938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da762b5-c2d6-498a-8b68-7262eac2ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:00.065930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da762b5-c2d6-498a-8b68-7262eac2ef41 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:00.066286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da762b5-c2d6-498a-8b68-7262eac2ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:00.068009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da762b5-c2d6-498a-8b68-7262eac2ef41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:00.068927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da762b5-c2d6-498a-8b68-7262eac2ef41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:00.071383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da762b5-c2d6-498a-8b68-7262eac2ef41 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:00.087107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 886/1780] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:00.093348 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da762b5-c2d6-498a-8b68-7262eac2ef41 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:00.127134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0b6b4-2dc8-41b5-bc85-ff08c59261d2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:00.139575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da762b5-c2d6-498a-8b68-7262eac2ef41 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:00.141580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57933b48-1f2d-4783-8f4d-3ac944b3668d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:00.142789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57933b48-1f2d-4783-8f4d-3ac944b3668d service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:00.144427 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57933b48-1f2d-4783-8f4d-3ac944b3668d service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:00.144750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57933b48-1f2d-4783-8f4d-3ac944b3668d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:00.147816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aac2bb-7c62-482b-93f2-d082fa9b2391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:00.149071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aac2bb-7c62-482b-93f2-d082fa9b2391 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:00.149350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aac2bb-7c62-482b-93f2-d082fa9b2391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:00.149955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aac2bb-7c62-482b-93f2-d082fa9b2391 admin admin] PATH_INFO: `/v3/projects/462c4651c10b401db9402fa891a8afc5/users/80148e670bd24153a2eeadc7848fed0c/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:00.151508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-57933b48-1f2d-4783-8f4d-3ac944b3668d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:00.196089 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aac2bb-7c62-482b-93f2-d082fa9b2391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462c4651c10b401db9402fa891a8afc5, user_id=80148e670bd24153a2eeadc7848fed0c, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:00.199454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aac2bb-7c62-482b-93f2-d082fa9b2391 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:00.266126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 887/1781] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:00 2022] PUT /identity/v3/projects/462c4651c10b401db9402fa891a8afc5/users/80148e670bd24153a2eeadc7848fed0c/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:00.272774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aac2bb-7c62-482b-93f2-d082fa9b2391 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:00.355291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57933b48-1f2d-4783-8f4d-3ac944b3668d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:00.355291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57933b48-1f2d-4783-8f4d-3ac944b3668d service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:00.405323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 895/1782] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:18:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:00.611537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aac2bb-7c62-482b-93f2-d082fa9b2391 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:00.635291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26406e-ab17-405e-962a-de076617dfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:00.637232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26406e-ab17-405e-962a-de076617dfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:00.637521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26406e-ab17-405e-962a-de076617dfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:00.637798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26406e-ab17-405e-962a-de076617dfc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:00.643377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26406e-ab17-405e-962a-de076617dfc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:00.651905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26406e-ab17-405e-962a-de076617dfc8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:00.706890 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57933b48-1f2d-4783-8f4d-3ac944b3668d service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:00.717598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 888/1783] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:00.736898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878efc1-d7f1-48c3-85a0-a47ffc24d37b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:00.737079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878efc1-d7f1-48c3-85a0-a47ffc24d37b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:00.737259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878efc1-d7f1-48c3-85a0-a47ffc24d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:00.737793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57933b48-1f2d-4783-8f4d-3ac944b3668d service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:00.772096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b83c1-d8b3-4ab4-abce-418efd5aee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:00.778315 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b83c1-d8b3-4ab4-abce-418efd5aee93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:00.778893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b83c1-d8b3-4ab4-abce-418efd5aee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:00.779349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b83c1-d8b3-4ab4-abce-418efd5aee93 admin admin] PATH_INFO: `/v3/projects/462c4651c10b401db9402fa891a8afc5/users/80148e670bd24153a2eeadc7848fed0c/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:00.784866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b83c1-d8b3-4ab4-abce-418efd5aee93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462c4651c10b401db9402fa891a8afc5, user_id=80148e670bd24153a2eeadc7848fed0c, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:00.793311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b83c1-d8b3-4ab4-abce-418efd5aee93 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:00.824710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1878efc1-d7f1-48c3-85a0-a47ffc24d37b None None] MFA Rules not processed for user `0bea4c8d195145a29eefee98e4b9ef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:00.824710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1878efc1-d7f1-48c3-85a0-a47ffc24d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:00.843953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 896/1784] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:00 2022] PUT /identity/v3/projects/462c4651c10b401db9402fa891a8afc5/users/80148e670bd24153a2eeadc7848fed0c/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:00.854923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e70017-e4e8-4be1-ad3a-3dc64307904d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:00.855974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e70017-e4e8-4be1-ad3a-3dc64307904d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:00.856936 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e70017-e4e8-4be1-ad3a-3dc64307904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:00.943470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-41e70017-e4e8-4be1-ad3a-3dc64307904d None None] MFA Rules not processed for user `80148e670bd24153a2eeadc7848fed0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:00.957362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-41e70017-e4e8-4be1-ad3a-3dc64307904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:01.120554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 889/1785] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:01.219428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 897/1786] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:00 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:01.280367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878efc1-d7f1-48c3-85a0-a47ffc24d37b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:01.508338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878efc1-d7f1-48c3-85a0-a47ffc24d37b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:01.530418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cea93-fe83-4bfe-9352-e73041644c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:01.531147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cea93-fe83-4bfe-9352-e73041644c23 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:01.531554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cea93-fe83-4bfe-9352-e73041644c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:01.531983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cea93-fe83-4bfe-9352-e73041644c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:01.575540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:01.592473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cea93-fe83-4bfe-9352-e73041644c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:01.615158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cea93-fe83-4bfe-9352-e73041644c23 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:01.704282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 890/1787] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:01.872992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e70017-e4e8-4be1-ad3a-3dc64307904d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:01.885025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e70017-e4e8-4be1-ad3a-3dc64307904d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:01.896127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e29c43-b9fa-4d65-a493-cb2f6dd1cd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:01.897085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e29c43-b9fa-4d65-a493-cb2f6dd1cd4a service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:01.897536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e29c43-b9fa-4d65-a493-cb2f6dd1cd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:01.897980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e29c43-b9fa-4d65-a493-cb2f6dd1cd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:01.942585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:02.047168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e29c43-b9fa-4d65-a493-cb2f6dd1cd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:02.066177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e29c43-b9fa-4d65-a493-cb2f6dd1cd4a service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:02.115472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 898/1788] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:02.605801 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cea93-fe83-4bfe-9352-e73041644c23 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:02.608222 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-086cea93-fe83-4bfe-9352-e73041644c23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:02.831717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cea93-fe83-4bfe-9352-e73041644c23 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:02.851825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:02.852787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:02.853071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:02.853347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] PATH_INFO: `/v3/users/8394225dc2654093b57bfce328664afb` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:02.855905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8394225dc2654093b57bfce328664afb)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:02.857832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:03.034223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8394225dc2654093b57bfce328664afb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:03.034967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8394225dc2654093b57bfce328664afb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:03.052069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8394225dc2654093b57bfce328664afb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:03.068643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8394225dc2654093b57bfce328664afb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:03.076457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8394225dc2654093b57bfce328664afb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:03.138849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 891/1789] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:02 2022] DELETE /identity/v3/users/8394225dc2654093b57bfce328664afb => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:03.143939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2a5d-db31-451c-8431-2e92e16a0781 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:03.145851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2a5d-db31-451c-8431-2e92e16a0781 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:03.146278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2a5d-db31-451c-8431-2e92e16a0781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:03.199342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-fd0c2a5d-db31-451c-8431-2e92e16a0781 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:03.209403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fd0c2a5d-db31-451c-8431-2e92e16a0781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:03.414098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 899/1790] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:03.498757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:03.500063 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:03.630195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a709d4-454a-40b6-820a-3a35690b581c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:03.642158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf887df-bc0c-4335-83f6-9bb5954b4182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:03.642857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf887df-bc0c-4335-83f6-9bb5954b4182 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:03.643711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf887df-bc0c-4335-83f6-9bb5954b4182 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:03.643711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf887df-bc0c-4335-83f6-9bb5954b4182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:03.674467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf887df-bc0c-4335-83f6-9bb5954b4182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:03.675758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf887df-bc0c-4335-83f6-9bb5954b4182 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:03.700906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 892/1791] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:04.645834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26f56-beaf-4508-ba18-709a1514a0f5 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:04.646442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26f56-beaf-4508-ba18-709a1514a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:04.646442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26f56-beaf-4508-ba18-709a1514a0f5 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:04.648071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 900/1792] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:19:04.682213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5495-de12-4658-a54b-5bb586966908 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:04.683283 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5495-de12-4658-a54b-5bb586966908 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:04.683731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5495-de12-4658-a54b-5bb586966908 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:04.689961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 893/1793] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:19:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:19:04.811596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4ec3c-dffb-4f1b-b8a3-7df79e33878c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:04.811887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4ec3c-dffb-4f1b-b8a3-7df79e33878c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:04.812237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4ec3c-dffb-4f1b-b8a3-7df79e33878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:04.841678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-93f4ec3c-dffb-4f1b-b8a3-7df79e33878c None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:04.843245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-93f4ec3c-dffb-4f1b-b8a3-7df79e33878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:04.970623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71296bf8-562e-4495-b5d6-04b9346216a0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:04.970938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71296bf8-562e-4495-b5d6-04b9346216a0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:04.972780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71296bf8-562e-4495-b5d6-04b9346216a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:05.040895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-71296bf8-562e-4495-b5d6-04b9346216a0 None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:05.044345 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-71296bf8-562e-4495-b5d6-04b9346216a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:05.101798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 901/1794] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:19:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:05.102155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:05.241216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 894/1795] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:19:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:06.695469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4ec3c-dffb-4f1b-b8a3-7df79e33878c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:06.698008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-93f4ec3c-dffb-4f1b-b8a3-7df79e33878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:06.817844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4ec3c-dffb-4f1b-b8a3-7df79e33878c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:06.834717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b51a08-2f8f-4894-80dd-fcaca988c7cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:06.835549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b51a08-2f8f-4894-80dd-fcaca988c7cc service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:06.836904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b51a08-2f8f-4894-80dd-fcaca988c7cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:06.837265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b51a08-2f8f-4894-80dd-fcaca988c7cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:06.845220 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e4b51a08-2f8f-4894-80dd-fcaca988c7cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:06.867618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:06.989858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b51a08-2f8f-4894-80dd-fcaca988c7cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:06.997880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b51a08-2f8f-4894-80dd-fcaca988c7cc service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:07.065431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 902/1796] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:07.351003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71296bf8-562e-4495-b5d6-04b9346216a0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:07.355015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-71296bf8-562e-4495-b5d6-04b9346216a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:07.435195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71296bf8-562e-4495-b5d6-04b9346216a0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:07.453327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:07.454296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:07.457764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:07.463030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] PATH_INFO: `/v3/projects/9b1995968b1848f4bbb95c384c8e3076` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:07.466032 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1995968b1848f4bbb95c384c8e3076)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:07.483111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:07.725507 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1995968b1848f4bbb95c384c8e3076', 'request_id': 'req-3337c438-4668-4af1-95be-06b07c339555'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:07.743298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1995968b1848f4bbb95c384c8e3076', 'request_id': 'req-3337c438-4668-4af1-95be-06b07c339555'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:07.764256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1995968b1848f4bbb95c384c8e3076', 'request_id': 'req-3337c438-4668-4af1-95be-06b07c339555'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:07.821750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] The token cache is being invalidate because project 9b1995968b1848f4bbb95c384c8e3076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:07.822359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:07.823216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:07.827955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 895/1797] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:07 2022] DELETE /identity/v3/projects/9b1995968b1848f4bbb95c384c8e3076 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:07.832473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b51a08-2f8f-4894-80dd-fcaca988c7cc service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:07.853927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b51a08-2f8f-4894-80dd-fcaca988c7cc service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:08.044750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:08.045926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:08.046998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:08.047470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] PATH_INFO: `/v3/users/c8d6f16b2a09457680fdfdbdd2c9109f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:08.048940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d6f16b2a09457680fdfdbdd2c9109f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:08.051322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:08.187716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d6f16b2a09457680fdfdbdd2c9109f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:08.200434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d6f16b2a09457680fdfdbdd2c9109f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:08.201936 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d6f16b2a09457680fdfdbdd2c9109f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:08.221538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d6f16b2a09457680fdfdbdd2c9109f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:08.222794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d6f16b2a09457680fdfdbdd2c9109f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:08.296388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 903/1798] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:07 2022] DELETE /identity/v3/users/c8d6f16b2a09457680fdfdbdd2c9109f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:08.641408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:08.645321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:08.781299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337c438-4668-4af1-95be-06b07c339555 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:08.828594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:08.844349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:08.846630 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:08.894254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:08.895236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940d8e-4ac2-4426-9418-37c9c0902168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:08.896451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940d8e-4ac2-4426-9418-37c9c0902168 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:08.896912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940d8e-4ac2-4426-9418-37c9c0902168 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:08.897340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940d8e-4ac2-4426-9418-37c9c0902168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:08.899786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2d940d8e-4ac2-4426-9418-37c9c0902168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:08.915004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d940d8e-4ac2-4426-9418-37c9c0902168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:08.917158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d940d8e-4ac2-4426-9418-37c9c0902168 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:08.950938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 896/1799] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:08.971011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb465c7-5b44-4232-b63f-02b6f811fa12 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:08.983889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0624d-3746-4e26-b889-adb8ffab981b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:08.985414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0624d-3746-4e26-b889-adb8ffab981b service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:08.985948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0624d-3746-4e26-b889-adb8ffab981b service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:08.986419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0624d-3746-4e26-b889-adb8ffab981b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:08.990051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-33c0624d-3746-4e26-b889-adb8ffab981b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:09.030551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0624d-3746-4e26-b889-adb8ffab981b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:09.032599 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0624d-3746-4e26-b889-adb8ffab981b service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:09.045551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 904/1800] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:09.086827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940d8e-4ac2-4426-9418-37c9c0902168 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:09.088477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2d940d8e-4ac2-4426-9418-37c9c0902168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:09.268251 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940d8e-4ac2-4426-9418-37c9c0902168 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:09.283675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:09.284581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:09.284900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:09.285232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] PATH_INFO: `/v3/projects/282d7effad2142d6af05b1edac9de5e0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:09.287866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=282d7effad2142d6af05b1edac9de5e0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:09.290980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:09.410404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282d7effad2142d6af05b1edac9de5e0', 'request_id': 'req-87ecfc4c-5284-4fe5-8663-f53cc6951f52'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:09.423904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282d7effad2142d6af05b1edac9de5e0', 'request_id': 'req-87ecfc4c-5284-4fe5-8663-f53cc6951f52'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:09.435044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282d7effad2142d6af05b1edac9de5e0', 'request_id': 'req-87ecfc4c-5284-4fe5-8663-f53cc6951f52'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:09.454698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] The token cache is being invalidate because project 282d7effad2142d6af05b1edac9de5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:09.454982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:09.455691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-87ecfc4c-5284-4fe5-8663-f53cc6951f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:09.457870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 897/1801] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:09 2022] DELETE /identity/v3/projects/282d7effad2142d6af05b1edac9de5e0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:09.463817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78802123-62e2-40f7-bc7b-3dfd00e192d7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:09.464526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78802123-62e2-40f7-bc7b-3dfd00e192d7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:09.465042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78802123-62e2-40f7-bc7b-3dfd00e192d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:09.498628 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-78802123-62e2-40f7-bc7b-3dfd00e192d7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:09.499864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-78802123-62e2-40f7-bc7b-3dfd00e192d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:09.642409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 905/1802] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:09.649868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48bd6c-2efa-4ffd-90e6-d9308a55ef8b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:09.651422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48bd6c-2efa-4ffd-90e6-d9308a55ef8b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:09.651891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48bd6c-2efa-4ffd-90e6-d9308a55ef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:09.676911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ab48bd6c-2efa-4ffd-90e6-d9308a55ef8b None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:09.678960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ab48bd6c-2efa-4ffd-90e6-d9308a55ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:09.704313 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 898/1803] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:09.705549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78802123-62e2-40f7-bc7b-3dfd00e192d7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:09.718322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78802123-62e2-40f7-bc7b-3dfd00e192d7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:09.724729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f146a-d80e-4f63-8e0d-85545bd66910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:09.725944 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f146a-d80e-4f63-8e0d-85545bd66910 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:09.726237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f146a-d80e-4f63-8e0d-85545bd66910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:09.726788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f146a-d80e-4f63-8e0d-85545bd66910 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:09.727434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f146a-d80e-4f63-8e0d-85545bd66910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:09.727749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f146a-d80e-4f63-8e0d-85545bd66910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:09.729763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f146a-d80e-4f63-8e0d-85545bd66910 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:09.797437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 906/1804] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:09.802038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48bd6c-2efa-4ffd-90e6-d9308a55ef8b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:09.815173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48bd6c-2efa-4ffd-90e6-d9308a55ef8b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:09.829752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a908a-b87f-46d3-aea9-434b6cd3952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:09.829752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a908a-b87f-46d3-aea9-434b6cd3952f admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:09.829752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a908a-b87f-46d3-aea9-434b6cd3952f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:09.829752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a908a-b87f-46d3-aea9-434b6cd3952f admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:09.830482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a908a-b87f-46d3-aea9-434b6cd3952f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:09.830482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a908a-b87f-46d3-aea9-434b6cd3952f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:09.881062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 899/1805] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:09 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:09.885044 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f146a-d80e-4f63-8e0d-85545bd66910 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:09.901407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f146a-d80e-4f63-8e0d-85545bd66910 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:09.981031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45d219-f4b4-41c9-8332-0bfa5d362a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:09.982047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45d219-f4b4-41c9-8332-0bfa5d362a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:09.982336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45d219-f4b4-41c9-8332-0bfa5d362a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:09.982624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45d219-f4b4-41c9-8332-0bfa5d362a8f admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:09.983321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45d219-f4b4-41c9-8332-0bfa5d362a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:09.986054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45d219-f4b4-41c9-8332-0bfa5d362a8f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:10.012797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 907/1806] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:09 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:10.017818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a908a-b87f-46d3-aea9-434b6cd3952f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:10.031996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a908a-b87f-46d3-aea9-434b6cd3952f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:10.038035 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a09c-bd3e-4a0d-8685-1ce4e25138ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:10.038779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a09c-bd3e-4a0d-8685-1ce4e25138ea admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.039176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a09c-bd3e-4a0d-8685-1ce4e25138ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.040153 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a09c-bd3e-4a0d-8685-1ce4e25138ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.040793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181a09c-bd3e-4a0d-8685-1ce4e25138ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:10.042950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181a09c-bd3e-4a0d-8685-1ce4e25138ea admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:10.060708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 900/1807] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:10.063367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45d219-f4b4-41c9-8332-0bfa5d362a8f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:10.080527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45d219-f4b4-41c9-8332-0bfa5d362a8f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:10.086887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad743a4c-9a51-4f7c-8988-4e59c8d5a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:10.087677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743a4c-9a51-4f7c-8988-4e59c8d5a6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.087961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743a4c-9a51-4f7c-8988-4e59c8d5a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.088235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743a4c-9a51-4f7c-8988-4e59c8d5a6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.089336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad743a4c-9a51-4f7c-8988-4e59c8d5a6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:10.091340 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad743a4c-9a51-4f7c-8988-4e59c8d5a6b3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:10.104709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 908/1808] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:10.106905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a09c-bd3e-4a0d-8685-1ce4e25138ea admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:10.116924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a09c-bd3e-4a0d-8685-1ce4e25138ea admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:10.121555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a012b-80aa-41a3-8dba-577daae16144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:10.122447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a012b-80aa-41a3-8dba-577daae16144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.122730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a012b-80aa-41a3-8dba-577daae16144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.123000 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a012b-80aa-41a3-8dba-577daae16144 admin admin] PATH_INFO: `/v3/projects/928d35debbf54c7fb7abe7d94eed73f0/users/65c425da0ee54b429dc1b0a0ac5067b2/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.125366 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:10.141367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a012b-80aa-41a3-8dba-577daae16144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928d35debbf54c7fb7abe7d94eed73f0, user_id=65c425da0ee54b429dc1b0a0ac5067b2, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:10.144235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a012b-80aa-41a3-8dba-577daae16144 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:10.160788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 901/1809] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:10 2022] PUT /identity/v3/projects/928d35debbf54c7fb7abe7d94eed73f0/users/65c425da0ee54b429dc1b0a0ac5067b2/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:10.172527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f2f02-e7a2-422d-b1ff-bb84a3045637 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.173162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f2f02-e7a2-422d-b1ff-bb84a3045637 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.173442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f2f02-e7a2-422d-b1ff-bb84a3045637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.204549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6a1f2f02-e7a2-422d-b1ff-bb84a3045637 None None] MFA Rules not processed for user `65c425da0ee54b429dc1b0a0ac5067b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:10.206304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6a1f2f02-e7a2-422d-b1ff-bb84a3045637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:10.215763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:10.276424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 909/1810] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:10.287907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a012b-80aa-41a3-8dba-577daae16144 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:10.289943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-109a012b-80aa-41a3-8dba-577daae16144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:10.317345 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f2f02-e7a2-422d-b1ff-bb84a3045637 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:10.318952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6a1f2f02-e7a2-422d-b1ff-bb84a3045637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:10.351056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a012b-80aa-41a3-8dba-577daae16144 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:10.355133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0ce4c-5818-4ce2-b985-6cff589a00ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:10.355801 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0ce4c-5818-4ce2-b985-6cff589a00ea service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.356080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0ce4c-5818-4ce2-b985-6cff589a00ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.356352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0ce4c-5818-4ce2-b985-6cff589a00ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.377991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0ce4c-5818-4ce2-b985-6cff589a00ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:10.379448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0ce4c-5818-4ce2-b985-6cff589a00ea service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:10.389068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 902/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:10.403955 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f2f02-e7a2-422d-b1ff-bb84a3045637 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:10.409441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0ce4c-5818-4ce2-b985-6cff589a00ea service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:10.411783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:10.412721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.413128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.413411 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] PATH_INFO: `/v3/users/063520702dcc4ffaad035d158d5d879d` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.414825 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] RBAC: Authorizing `identity:delete_user(user_id=063520702dcc4ffaad035d158d5d879d)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:10.416794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:10.421566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0ce4c-5818-4ce2-b985-6cff589a00ea service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:10.426992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:10.427886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.428226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.428437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] PATH_INFO: `/v3/users/65c425da0ee54b429dc1b0a0ac5067b2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.430005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c425da0ee54b429dc1b0a0ac5067b2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:10.431963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:10.472431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063520702dcc4ffaad035d158d5d879d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:10.482356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063520702dcc4ffaad035d158d5d879d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:10.483173 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063520702dcc4ffaad035d158d5d879d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:10.486552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c425da0ee54b429dc1b0a0ac5067b2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:10.487310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c425da0ee54b429dc1b0a0ac5067b2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:10.490715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063520702dcc4ffaad035d158d5d879d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:10.491463 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1bd1236-4762-4bc7-8ce4-392b1847587e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063520702dcc4ffaad035d158d5d879d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:10.498379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c425da0ee54b429dc1b0a0ac5067b2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:10.506358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c425da0ee54b429dc1b0a0ac5067b2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:10.507041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86e700d5-2f24-4cfc-9c3a-986a1c4113c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c425da0ee54b429dc1b0a0ac5067b2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:10.513570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 910/1812] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:10 2022] DELETE /identity/v3/users/063520702dcc4ffaad035d158d5d879d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:10.518086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1273f0-9455-4d70-911a-65c9c680f90c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.518378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1273f0-9455-4d70-911a-65c9c680f90c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.518651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1273f0-9455-4d70-911a-65c9c680f90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.527112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 903/1813] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:10 2022] DELETE /identity/v3/users/65c425da0ee54b429dc1b0a0ac5067b2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:10.532986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8e6b1-efee-4587-a628-08919cae646e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.533327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8e6b1-efee-4587-a628-08919cae646e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.533668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8e6b1-efee-4587-a628-08919cae646e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.567001 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4a1273f0-9455-4d70-911a-65c9c680f90c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:10.569725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4a1273f0-9455-4d70-911a-65c9c680f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:10.577984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-53d8e6b1-efee-4587-a628-08919cae646e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:10.579546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-53d8e6b1-efee-4587-a628-08919cae646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:10.630094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:10.660810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:10.680435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 904/1814] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:10.684034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 911/1815] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:10.696428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8e6b1-efee-4587-a628-08919cae646e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:10.696609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1273f0-9455-4d70-911a-65c9c680f90c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:10.697847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-53d8e6b1-efee-4587-a628-08919cae646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:10.698383 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4a1273f0-9455-4d70-911a-65c9c680f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:10.759615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8e6b1-efee-4587-a628-08919cae646e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:10.764592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcea33-053c-4734-8655-4e5c2ec2caeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:10.765225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcea33-053c-4734-8655-4e5c2ec2caeb service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.765505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcea33-053c-4734-8655-4e5c2ec2caeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.765780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcea33-053c-4734-8655-4e5c2ec2caeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.769234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1273f0-9455-4d70-911a-65c9c680f90c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:10.773563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d72d0-0191-4400-8600-64f7c99b7e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:10.774231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d72d0-0191-4400-8600-64f7c99b7e6f service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:10.775166 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d72d0-0191-4400-8600-64f7c99b7e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:10.775166 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d72d0-0191-4400-8600-64f7c99b7e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:10.777723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcea33-053c-4734-8655-4e5c2ec2caeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:10.780807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcea33-053c-4734-8655-4e5c2ec2caeb service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:10.785356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d72d0-0191-4400-8600-64f7c99b7e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:10.786949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d72d0-0191-4400-8600-64f7c99b7e6f service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:10.795445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 905/1816] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:10.797691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 912/1817] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:11.104328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcea33-053c-4734-8655-4e5c2ec2caeb service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:11.106595 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8adcea33-053c-4734-8655-4e5c2ec2caeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:11.119664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcea33-053c-4734-8655-4e5c2ec2caeb service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:11.125764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:11.126727 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:11.126993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:11.127273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] PATH_INFO: `/v3/users/e84f8a8c34eb4ee5b1dd406743f3f4e6` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:11.128511 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84f8a8c34eb4ee5b1dd406743f3f4e6)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:11.130613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:11.193387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84f8a8c34eb4ee5b1dd406743f3f4e6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:11.194344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84f8a8c34eb4ee5b1dd406743f3f4e6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:11.213301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84f8a8c34eb4ee5b1dd406743f3f4e6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:11.233776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84f8a8c34eb4ee5b1dd406743f3f4e6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:11.234816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84f8a8c34eb4ee5b1dd406743f3f4e6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:11.267934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 906/1818] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:11 2022] DELETE /identity/v3/users/e84f8a8c34eb4ee5b1dd406743f3f4e6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:11.269513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc3b12-5cc9-48df-8284-295d8ddf6c03 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:11.270014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc3b12-5cc9-48df-8284-295d8ddf6c03 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:11.270090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc3b12-5cc9-48df-8284-295d8ddf6c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:11.298807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-26bc3b12-5cc9-48df-8284-295d8ddf6c03 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:11.300445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-26bc3b12-5cc9-48df-8284-295d8ddf6c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:11.521876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 913/1819] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:11.546374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:11.554241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:11.654469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59089a-5b14-4d80-a8a8-d3b08918421d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:11.676094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c3333-0270-406c-a96c-a4bfa60ea940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:11.677213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3333-0270-406c-a96c-a4bfa60ea940 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:11.677541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3333-0270-406c-a96c-a4bfa60ea940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:11.677865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3333-0270-406c-a96c-a4bfa60ea940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:11.713883 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c3333-0270-406c-a96c-a4bfa60ea940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:11.715852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c3333-0270-406c-a96c-a4bfa60ea940 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:11.731908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 907/1820] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:12.417701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc3b12-5cc9-48df-8284-295d8ddf6c03 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:12.419237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-26bc3b12-5cc9-48df-8284-295d8ddf6c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:12.432107 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc3b12-5cc9-48df-8284-295d8ddf6c03 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:12.437946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:12.438995 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:12.439620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:12.440098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] PATH_INFO: `/v3/projects/47c7d99223ee4b9496c36c84e7afa95f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:12.441648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c7d99223ee4b9496c36c84e7afa95f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:12.443783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:12.522043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c7d99223ee4b9496c36c84e7afa95f', 'request_id': 'req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.530879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c7d99223ee4b9496c36c84e7afa95f', 'request_id': 'req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.538782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c3333-0270-406c-a96c-a4bfa60ea940 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:12.540191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8e9c3333-0270-406c-a96c-a4bfa60ea940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:12.552951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c7d99223ee4b9496c36c84e7afa95f', 'request_id': 'req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.557361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:12.561419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c3333-0270-406c-a96c-a4bfa60ea940 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:12.576646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] The token cache is being invalidate because project 47c7d99223ee4b9496c36c84e7afa95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:12.577464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.580994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.584094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 914/1821] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:12 2022] DELETE /identity/v3/projects/47c7d99223ee4b9496c36c84e7afa95f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:12.587834 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:12.590450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:12.592233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:12.686675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:12.687572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:12.687869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:12.688208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] PATH_INFO: `/v3/projects/4122e326acd446409d9502cb3e3a6253` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:12.689498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4122e326acd446409d9502cb3e3a6253)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:12.692098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:12.730945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2147f7-ca05-44d9-ab41-5ef13fcd0131 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:12.737232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:12.738164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:12.738587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:12.738907 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] PATH_INFO: `/v3/users/1ed31f0d659245359621bf27948c39b8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:12.740298 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed31f0d659245359621bf27948c39b8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:12.742523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:12.760546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4122e326acd446409d9502cb3e3a6253', 'request_id': 'req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.769785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4122e326acd446409d9502cb3e3a6253', 'request_id': 'req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.777099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4122e326acd446409d9502cb3e3a6253', 'request_id': 'req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.790857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] The token cache is being invalidate because project 4122e326acd446409d9502cb3e3a6253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:12.792477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.793941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.797782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 908/1822] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:12 2022] DELETE /identity/v3/projects/4122e326acd446409d9502cb3e3a6253 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:12.799815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:12.802729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:12.806781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed31f0d659245359621bf27948c39b8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.815612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed31f0d659245359621bf27948c39b8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.816297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed31f0d659245359621bf27948c39b8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.824326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed31f0d659245359621bf27948c39b8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.825268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed31f0d659245359621bf27948c39b8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:12.912924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 915/1823] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:12 2022] DELETE /identity/v3/users/1ed31f0d659245359621bf27948c39b8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:12.913223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:12.938094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:12.993144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e534f-cd57-44aa-b0cb-2b4bf2a84c90 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:13.089888 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ad57-7a6b-4d4b-9207-1d1f0257d243 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:13.093605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:13.095601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:13.096616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:13.096956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:13.097266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] PATH_INFO: `/v3/users/80148e670bd24153a2eeadc7848fed0c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:13.098883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=80148e670bd24153a2eeadc7848fed0c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:13.101733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:13.116000 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:13.116941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:13.117319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:13.117641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] PATH_INFO: `/v3/projects/928d35debbf54c7fb7abe7d94eed73f0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:13.119641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] RBAC: Authorizing `identity:delete_project(project_id=928d35debbf54c7fb7abe7d94eed73f0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:13.121612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:13.151243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:13.215490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80148e670bd24153a2eeadc7848fed0c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.231121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928d35debbf54c7fb7abe7d94eed73f0', 'request_id': 'req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.234585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80148e670bd24153a2eeadc7848fed0c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.236229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80148e670bd24153a2eeadc7848fed0c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.249680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928d35debbf54c7fb7abe7d94eed73f0', 'request_id': 'req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.252832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80148e670bd24153a2eeadc7848fed0c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.253725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f492a897-780d-4740-bb1d-0c0b8b5b8d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80148e670bd24153a2eeadc7848fed0c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.266525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928d35debbf54c7fb7abe7d94eed73f0', 'request_id': 'req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.277442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 916/1824] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:12 2022] DELETE /identity/v3/users/80148e670bd24153a2eeadc7848fed0c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:13.294664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] The token cache is being invalidate because project 928d35debbf54c7fb7abe7d94eed73f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:13.294975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.295754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.298155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 909/1825] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:12 2022] DELETE /identity/v3/projects/928d35debbf54c7fb7abe7d94eed73f0 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:13.303500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88984ca-f6b5-42a7-b6cc-6ef5b4b65472 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:13.304079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88984ca-f6b5-42a7-b6cc-6ef5b4b65472 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:13.304531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88984ca-f6b5-42a7-b6cc-6ef5b4b65472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:13.333616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f88984ca-f6b5-42a7-b6cc-6ef5b4b65472 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:13.335299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f88984ca-f6b5-42a7-b6cc-6ef5b4b65472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:13.355664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:13.357845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:13.480489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7fbe9-8b4e-4099-93f3-6fa5f142519a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:13.481500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 917/1826] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:13.489110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:13.489319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50e2cd-709d-4220-a1ac-7b9684572108 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:13.489742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50e2cd-709d-4220-a1ac-7b9684572108 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:13.490091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50e2cd-709d-4220-a1ac-7b9684572108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:13.490617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:13.490976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:13.491319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] PATH_INFO: `/v3/projects/054459fd2f7c4aac856c9c122877b333` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:13.492752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054459fd2f7c4aac856c9c122877b333)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:13.494899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:13.515216 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5a50e2cd-709d-4220-a1ac-7b9684572108 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:13.518039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5a50e2cd-709d-4220-a1ac-7b9684572108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:13.531653 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 918/1827] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:13.537367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50e2cd-709d-4220-a1ac-7b9684572108 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:13.553874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50e2cd-709d-4220-a1ac-7b9684572108 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:13.564422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054459fd2f7c4aac856c9c122877b333', 'request_id': 'req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.586866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054459fd2f7c4aac856c9c122877b333', 'request_id': 'req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.597764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054459fd2f7c4aac856c9c122877b333', 'request_id': 'req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.626771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] The token cache is being invalidate because project 054459fd2f7c4aac856c9c122877b333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:13.628013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.629268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.632121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 910/1828] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:13 2022] DELETE /identity/v3/projects/054459fd2f7c4aac856c9c122877b333 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:13.636289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:13.638830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:13.654516 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e905ff-b9ad-4287-aa48-991d5abf54b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:13.657858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e905ff-b9ad-4287-aa48-991d5abf54b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:13.658963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e905ff-b9ad-4287-aa48-991d5abf54b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:13.659378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e905ff-b9ad-4287-aa48-991d5abf54b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:13.660571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e905ff-b9ad-4287-aa48-991d5abf54b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:13.661203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e905ff-b9ad-4287-aa48-991d5abf54b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:13.661833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:13.664530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e905ff-b9ad-4287-aa48-991d5abf54b9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:13.684119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 919/1829] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:13.689677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e905ff-b9ad-4287-aa48-991d5abf54b9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:13.694020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-46e905ff-b9ad-4287-aa48-991d5abf54b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:13.708016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e905ff-b9ad-4287-aa48-991d5abf54b9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:13.714195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d681334-7e67-4aac-b36e-5948ee8bd84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:13.715048 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d681334-7e67-4aac-b36e-5948ee8bd84f admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:13.715435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d681334-7e67-4aac-b36e-5948ee8bd84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:13.715810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d681334-7e67-4aac-b36e-5948ee8bd84f admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:13.716634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d681334-7e67-4aac-b36e-5948ee8bd84f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:13.718801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d681334-7e67-4aac-b36e-5948ee8bd84f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:13.744864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:13.757545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da4e64-dec1-4a2a-82b3-180ed00f3f33 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:13.761788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 920/1830] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:13 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:13.762739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d681334-7e67-4aac-b36e-5948ee8bd84f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:13.846818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:13.847729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:13.848015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:13.848302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] PATH_INFO: `/v3/users/a0fa04a897bf4545b39a7082657fcfd6` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:13.849575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0fa04a897bf4545b39a7082657fcfd6)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:13.851532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:13.868602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d681334-7e67-4aac-b36e-5948ee8bd84f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:13.877648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16b31f-02ab-4879-b413-cec487bbf948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:13.878553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16b31f-02ab-4879-b413-cec487bbf948 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:13.878786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16b31f-02ab-4879-b413-cec487bbf948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:13.879460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16b31f-02ab-4879-b413-cec487bbf948 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:13.879768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16b31f-02ab-4879-b413-cec487bbf948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:13.883698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16b31f-02ab-4879-b413-cec487bbf948 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:13.918171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 921/1831] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:13 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:13.922263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16b31f-02ab-4879-b413-cec487bbf948 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:13.947011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16b31f-02ab-4879-b413-cec487bbf948 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:13.963359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bf47a-de9d-401c-a375-6b6339d66bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:13.964635 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0fa04a897bf4545b39a7082657fcfd6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.965037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bf47a-de9d-401c-a375-6b6339d66bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:13.965325 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bf47a-de9d-401c-a375-6b6339d66bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:13.965610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bf47a-de9d-401c-a375-6b6339d66bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:13.968216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0fa04a897bf4545b39a7082657fcfd6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:13.986727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bf47a-de9d-401c-a375-6b6339d66bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:13.990089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bf47a-de9d-401c-a375-6b6339d66bfc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:13.991049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0fa04a897bf4545b39a7082657fcfd6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:14.006608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0fa04a897bf4545b39a7082657fcfd6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:14.007386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0fa04a897bf4545b39a7082657fcfd6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:14.014717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 922/1832] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:14.015827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bf47a-de9d-401c-a375-6b6339d66bfc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:14.018989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c51bf47a-de9d-401c-a375-6b6339d66bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:14.035873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bf47a-de9d-401c-a375-6b6339d66bfc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:14.044705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6c092-0f9a-432d-8433-845ee74add9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:14.045927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6c092-0f9a-432d-8433-845ee74add9d admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:14.046483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6c092-0f9a-432d-8433-845ee74add9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:14.047072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6c092-0f9a-432d-8433-845ee74add9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:14.048167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6c092-0f9a-432d-8433-845ee74add9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:14.050765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6c092-0f9a-432d-8433-845ee74add9d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:14.053923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 911/1833] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:13 2022] DELETE /identity/v3/users/a0fa04a897bf4545b39a7082657fcfd6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:14.076108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 923/1834] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:14.080441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:14.143298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:14.195069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc69ae-efbf-4033-99a5-0cc3ca41c9a7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:14.206138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf06d7a-f630-43d6-8bdb-d4dc597c6b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:14.208505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf06d7a-f630-43d6-8bdb-d4dc597c6b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:14.212529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf06d7a-f630-43d6-8bdb-d4dc597c6b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:14.213011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf06d7a-f630-43d6-8bdb-d4dc597c6b78 admin admin] PATH_INFO: `/v3/projects/a17b00c69d744b0c90dbae1ec7e06c5d/users/9cc02d10a6dc4bf5a8a82d68ad06e99d/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:14.249004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf06d7a-f630-43d6-8bdb-d4dc597c6b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17b00c69d744b0c90dbae1ec7e06c5d, user_id=9cc02d10a6dc4bf5a8a82d68ad06e99d, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:14.251966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf06d7a-f630-43d6-8bdb-d4dc597c6b78 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:14.269962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 912/1835] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:14 2022] PUT /identity/v3/projects/a17b00c69d744b0c90dbae1ec7e06c5d/users/9cc02d10a6dc4bf5a8a82d68ad06e99d/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:14.280375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240994-fa8e-4499-b439-a259398b5ada None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:14.281046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240994-fa8e-4499-b439-a259398b5ada None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:14.281046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240994-fa8e-4499-b439-a259398b5ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:14.313499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b5240994-fa8e-4499-b439-a259398b5ada None None] MFA Rules not processed for user `9cc02d10a6dc4bf5a8a82d68ad06e99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:14.315216 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b5240994-fa8e-4499-b439-a259398b5ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:14.455336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 924/1836] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:14.468027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf06d7a-f630-43d6-8bdb-d4dc597c6b78 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:14.470424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-abf06d7a-f630-43d6-8bdb-d4dc597c6b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:14.566529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf06d7a-f630-43d6-8bdb-d4dc597c6b78 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:14.573003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44855d-4936-49d6-9bb6-2eacb1d723cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:14.576502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44855d-4936-49d6-9bb6-2eacb1d723cd service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:14.577225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44855d-4936-49d6-9bb6-2eacb1d723cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:14.577225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44855d-4936-49d6-9bb6-2eacb1d723cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:14.593881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44855d-4936-49d6-9bb6-2eacb1d723cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:14.596392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44855d-4936-49d6-9bb6-2eacb1d723cd service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:14.612164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 913/1837] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:14.909541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5240994-fa8e-4499-b439-a259398b5ada None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:14.910991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b5240994-fa8e-4499-b439-a259398b5ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:15.088505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:15.100458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5240994-fa8e-4499-b439-a259398b5ada None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:15.116313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:15.119645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.121210 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.121622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] PATH_INFO: `/v3/projects/462c4651c10b401db9402fa891a8afc5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.130286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=462c4651c10b401db9402fa891a8afc5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:15.132323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:15.207616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462c4651c10b401db9402fa891a8afc5', 'request_id': 'req-e4bab873-b8d9-42ab-91a7-7768e352e8ac'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:15.219456 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462c4651c10b401db9402fa891a8afc5', 'request_id': 'req-e4bab873-b8d9-42ab-91a7-7768e352e8ac'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:15.233023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462c4651c10b401db9402fa891a8afc5', 'request_id': 'req-e4bab873-b8d9-42ab-91a7-7768e352e8ac'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:15.262553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] The token cache is being invalidate because project 462c4651c10b401db9402fa891a8afc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:15.262906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:15.263730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4bab873-b8d9-42ab-91a7-7768e352e8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:15.265805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 925/1838] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:14 2022] DELETE /identity/v3/projects/462c4651c10b401db9402fa891a8afc5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:15.271434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d07849-8788-47ce-9e93-eb7ee4f0e8f0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.272019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d07849-8788-47ce-9e93-eb7ee4f0e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.272019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d07849-8788-47ce-9e93-eb7ee4f0e8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.294578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-91d07849-8788-47ce-9e93-eb7ee4f0e8f0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:15.296002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-91d07849-8788-47ce-9e93-eb7ee4f0e8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:15.383006 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 914/1839] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:15.391030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595df9f-5546-41dd-8f91-098b6c4708b4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.391724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595df9f-5546-41dd-8f91-098b6c4708b4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.391724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595df9f-5546-41dd-8f91-098b6c4708b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.434421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8595df9f-5546-41dd-8f91-098b6c4708b4 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:15.436354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8595df9f-5546-41dd-8f91-098b6c4708b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:15.453505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d07849-8788-47ce-9e93-eb7ee4f0e8f0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:15.468958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 926/1840] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:15.469291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d07849-8788-47ce-9e93-eb7ee4f0e8f0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:15.485398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eb17b-9479-49c1-98d5-600d5690eb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:15.486338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb17b-9479-49c1-98d5-600d5690eb7d admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.487171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb17b-9479-49c1-98d5-600d5690eb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.487695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb17b-9479-49c1-98d5-600d5690eb7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.488654 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb17b-9479-49c1-98d5-600d5690eb7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:15.489305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb17b-9479-49c1-98d5-600d5690eb7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:15.490590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595df9f-5546-41dd-8f91-098b6c4708b4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:15.491245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb17b-9479-49c1-98d5-600d5690eb7d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:15.492188 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8595df9f-5546-41dd-8f91-098b6c4708b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:15.513685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595df9f-5546-41dd-8f91-098b6c4708b4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:15.517747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 915/1841] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:19:15.522404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eb17b-9479-49c1-98d5-600d5690eb7d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:15.524429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:15.525969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.526347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.526727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] PATH_INFO: `/v3/projects/21bcdde457fe4c94ab8ab2bd688542f7` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.528243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=21bcdde457fe4c94ab8ab2bd688542f7)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:15.530365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:15.550174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eb17b-9479-49c1-98d5-600d5690eb7d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:15.555912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eef8c-8e39-4310-8761-989d6bf699eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:15.556700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eef8c-8e39-4310-8761-989d6bf699eb admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.556912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eef8c-8e39-4310-8761-989d6bf699eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.557672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eef8c-8e39-4310-8761-989d6bf699eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.557892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eef8c-8e39-4310-8761-989d6bf699eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:15.562022 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eef8c-8e39-4310-8761-989d6bf699eb admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:15.616442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 916/1842] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:15 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:15.618190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eef8c-8e39-4310-8761-989d6bf699eb admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:15.631263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21bcdde457fe4c94ab8ab2bd688542f7', 'request_id': 'req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:15.652269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21bcdde457fe4c94ab8ab2bd688542f7', 'request_id': 'req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:15.667527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21bcdde457fe4c94ab8ab2bd688542f7', 'request_id': 'req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:15.684867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] The token cache is being invalidate because project 21bcdde457fe4c94ab8ab2bd688542f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:15.685192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:15.685869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8d35d38-3c5f-431e-a85d-acfe566d0cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:15.692022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 927/1843] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:15 2022] DELETE /identity/v3/projects/21bcdde457fe4c94ab8ab2bd688542f7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:15.693525 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ded498-cd33-4063-95ed-99218792270f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.693817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ded498-cd33-4063-95ed-99218792270f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.694102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ded498-cd33-4063-95ed-99218792270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.709847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:15.727679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-90ded498-cd33-4063-95ed-99218792270f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:15.729012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-90ded498-cd33-4063-95ed-99218792270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:15.795932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eef8c-8e39-4310-8761-989d6bf699eb admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:15.807547 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07295057-38d6-4114-a082-b4f4d6e39088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:15.813299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295057-38d6-4114-a082-b4f4d6e39088 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.813973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295057-38d6-4114-a082-b4f4d6e39088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.814446 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295057-38d6-4114-a082-b4f4d6e39088 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.815420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07295057-38d6-4114-a082-b4f4d6e39088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:15.820094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07295057-38d6-4114-a082-b4f4d6e39088 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:15.828046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 928/1844] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:15.840772 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064091-a891-4400-adf0-e689abff4ac9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.841156 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064091-a891-4400-adf0-e689abff4ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.841450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064091-a891-4400-adf0-e689abff4ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.860466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:15.865987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 917/1845] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:15 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:15.868518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07295057-38d6-4114-a082-b4f4d6e39088 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:15.871906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-07295057-38d6-4114-a082-b4f4d6e39088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:15.884615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d2064091-a891-4400-adf0-e689abff4ac9 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:15.887597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d2064091-a891-4400-adf0-e689abff4ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:15.899494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 929/1846] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:15.903806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2064091-a891-4400-adf0-e689abff4ac9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:15.903991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07295057-38d6-4114-a082-b4f4d6e39088 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:15.916207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67fcac-3177-4dad-a787-ab097cd2fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:15.916965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67fcac-3177-4dad-a787-ab097cd2fa8f admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.917257 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67fcac-3177-4dad-a787-ab097cd2fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.917540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67fcac-3177-4dad-a787-ab097cd2fa8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.918558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67fcac-3177-4dad-a787-ab097cd2fa8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:15.920208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67fcac-3177-4dad-a787-ab097cd2fa8f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:15.924778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2064091-a891-4400-adf0-e689abff4ac9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:15.938098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ce10-0264-4a99-a2ef-4351c09d0741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:15.939042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ce10-0264-4a99-a2ef-4351c09d0741 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.939327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ce10-0264-4a99-a2ef-4351c09d0741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.939605 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ce10-0264-4a99-a2ef-4351c09d0741 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.941424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39ce10-0264-4a99-a2ef-4351c09d0741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:15.941736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39ce10-0264-4a99-a2ef-4351c09d0741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:15.943890 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39ce10-0264-4a99-a2ef-4351c09d0741 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:15.946169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 918/1847] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:15.950738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67fcac-3177-4dad-a787-ab097cd2fa8f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:15.973765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 930/1848] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:19:15.978154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67fcac-3177-4dad-a787-ab097cd2fa8f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:15.980579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ce10-0264-4a99-a2ef-4351c09d0741 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:15.991965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f0459-35cc-44a3-a6d0-843bd79ad1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:15.992780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0459-35cc-44a3-a6d0-843bd79ad1be admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:15.993074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0459-35cc-44a3-a6d0-843bd79ad1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:15.993353 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f0459-35cc-44a3-a6d0-843bd79ad1be admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:15.994163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f0459-35cc-44a3-a6d0-843bd79ad1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:15.995806 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f0459-35cc-44a3-a6d0-843bd79ad1be admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.003961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ce10-0264-4a99-a2ef-4351c09d0741 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:16.010502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5b6ac-a704-40d1-9372-d480264e89d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:16.011754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5b6ac-a704-40d1-9372-d480264e89d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.011754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5b6ac-a704-40d1-9372-d480264e89d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.011954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5b6ac-a704-40d1-9372-d480264e89d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.012561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5b6ac-a704-40d1-9372-d480264e89d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:16.014535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5b6ac-a704-40d1-9372-d480264e89d0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.033449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 919/1849] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:16.037414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f0459-35cc-44a3-a6d0-843bd79ad1be admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:16.052214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f0459-35cc-44a3-a6d0-843bd79ad1be admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:16.058095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a2ec8-3c6f-425c-b29c-8351feedbd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:16.060144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a2ec8-3c6f-425c-b29c-8351feedbd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.060485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a2ec8-3c6f-425c-b29c-8351feedbd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.060970 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a2ec8-3c6f-425c-b29c-8351feedbd47 admin admin] PATH_INFO: `/v3/projects/06bfb9df79d2444fa11c2cfc1774ded2/users/7c74b5cb8471426b9aeaa875ef024bdb/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.068555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 931/1850] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:15 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:16.074164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5b6ac-a704-40d1-9372-d480264e89d0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:16.093780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a2ec8-3c6f-425c-b29c-8351feedbd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bfb9df79d2444fa11c2cfc1774ded2, user_id=7c74b5cb8471426b9aeaa875ef024bdb, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:16.096576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a2ec8-3c6f-425c-b29c-8351feedbd47 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.133286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 920/1851] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:16 2022] PUT /identity/v3/projects/06bfb9df79d2444fa11c2cfc1774ded2/users/7c74b5cb8471426b9aeaa875ef024bdb/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:16.134187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aaa29-0dc3-4e58-a26c-915f44025a06 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.138246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aaa29-0dc3-4e58-a26c-915f44025a06 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.138246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aaa29-0dc3-4e58-a26c-915f44025a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.165988 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5b6ac-a704-40d1-9372-d480264e89d0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:16.188676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3a1aaa29-0dc3-4e58-a26c-915f44025a06 None None] MFA Rules not processed for user `7c74b5cb8471426b9aeaa875ef024bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:16.189986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3a1aaa29-0dc3-4e58-a26c-915f44025a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:16.318619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dafd6-bc22-49cd-9aca-a0bb991a712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:16.319348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dafd6-bc22-49cd-9aca-a0bb991a712f admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.319769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dafd6-bc22-49cd-9aca-a0bb991a712f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.320055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dafd6-bc22-49cd-9aca-a0bb991a712f admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.332500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 921/1852] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:16.333199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dafd6-bc22-49cd-9aca-a0bb991a712f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:16.333199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dafd6-bc22-49cd-9aca-a0bb991a712f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.333686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1aaa29-0dc3-4e58-a26c-915f44025a06 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:16.358698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1aaa29-0dc3-4e58-a26c-915f44025a06 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:16.384585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 932/1853] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:16 2022] POST /identity/v3/users => generated 292 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:16.388718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dafd6-bc22-49cd-9aca-a0bb991a712f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:16.397008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe4009-a16c-4cfb-8f37-735603dde9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:16.397974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4009-a16c-4cfb-8f37-735603dde9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.398414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4009-a16c-4cfb-8f37-735603dde9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.398947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4009-a16c-4cfb-8f37-735603dde9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.399860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe4009-a16c-4cfb-8f37-735603dde9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:16.407328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe4009-a16c-4cfb-8f37-735603dde9d2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.421017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dafd6-bc22-49cd-9aca-a0bb991a712f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:16.437286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d934f1-3c4c-4583-93df-11872c2e0f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:16.438665 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d934f1-3c4c-4583-93df-11872c2e0f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.439094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d934f1-3c4c-4583-93df-11872c2e0f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.439598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d934f1-3c4c-4583-93df-11872c2e0f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.440449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d934f1-3c4c-4583-93df-11872c2e0f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:16.445571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d934f1-3c4c-4583-93df-11872c2e0f26 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.461627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 922/1854] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:16 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:16.466079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe4009-a16c-4cfb-8f37-735603dde9d2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:16.470214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 933/1855] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:16.474423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d934f1-3c4c-4583-93df-11872c2e0f26 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:16.493862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d934f1-3c4c-4583-93df-11872c2e0f26 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:16.540641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:16.578599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe4009-a16c-4cfb-8f37-735603dde9d2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:16.595506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215129a-5cac-4fca-bf01-cbe45cd9525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:16.596269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215129a-5cac-4fca-bf01-cbe45cd9525d admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.596552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215129a-5cac-4fca-bf01-cbe45cd9525d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.597275 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215129a-5cac-4fca-bf01-cbe45cd9525d admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.598327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215129a-5cac-4fca-bf01-cbe45cd9525d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:16.601500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215129a-5cac-4fca-bf01-cbe45cd9525d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.602400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:16.630533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b50038-ec66-45fa-a1af-aad0014ec206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:16.630779 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b50038-ec66-45fa-a1af-aad0014ec206 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.631098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b50038-ec66-45fa-a1af-aad0014ec206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.631265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b50038-ec66-45fa-a1af-aad0014ec206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.632836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b50038-ec66-45fa-a1af-aad0014ec206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:16.636363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b50038-ec66-45fa-a1af-aad0014ec206 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.652023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 923/1856] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:16 2022] POST /identity/v3/users => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:16.653516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0130174-55ae-44cb-ac07-8dabc1cff2e8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.655310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0130174-55ae-44cb-ac07-8dabc1cff2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.655621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0130174-55ae-44cb-ac07-8dabc1cff2e8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.663088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 934/1857] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:16.664055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 924/1858] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:19:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:19:16.664874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b50038-ec66-45fa-a1af-aad0014ec206 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:16.667083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0130174-55ae-44cb-ac07-8dabc1cff2e8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:16.687328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b50038-ec66-45fa-a1af-aad0014ec206 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:16.698576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0130174-55ae-44cb-ac07-8dabc1cff2e8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:16.699220 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c495e50-0b1e-4599-aba1-eeb90f6121d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:16.701199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c495e50-0b1e-4599-aba1-eeb90f6121d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.701848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c495e50-0b1e-4599-aba1-eeb90f6121d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.702671 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c495e50-0b1e-4599-aba1-eeb90f6121d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.703769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c495e50-0b1e-4599-aba1-eeb90f6121d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:16.705956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c495e50-0b1e-4599-aba1-eeb90f6121d2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.710021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9afe3-355f-476c-b416-b5bb1ec39e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:16.710944 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9afe3-355f-476c-b416-b5bb1ec39e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.711310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9afe3-355f-476c-b416-b5bb1ec39e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.711587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9afe3-355f-476c-b416-b5bb1ec39e10 admin admin] PATH_INFO: `/v3/projects/9515d697b12e43b1a1dfd664625459d2/users/26e7f8e6fdc241f6a8cc425734d8eff0/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.728933 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 935/1859] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:16.739646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d834-9b7d-4ec2-96a7-40e5da34e5a3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.740128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d834-9b7d-4ec2-96a7-40e5da34e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.740730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d834-9b7d-4ec2-96a7-40e5da34e5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.755108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9afe3-355f-476c-b416-b5bb1ec39e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9515d697b12e43b1a1dfd664625459d2, user_id=26e7f8e6fdc241f6a8cc425734d8eff0, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:16.759302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9afe3-355f-476c-b416-b5bb1ec39e10 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.780574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ab26d834-9b7d-4ec2-96a7-40e5da34e5a3 None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:16.782399 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ab26d834-9b7d-4ec2-96a7-40e5da34e5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:16.785798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 925/1860] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:16 2022] PUT /identity/v3/projects/9515d697b12e43b1a1dfd664625459d2/users/26e7f8e6fdc241f6a8cc425734d8eff0/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:16.786694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9afe3-355f-476c-b416-b5bb1ec39e10 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:16.889163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9afe3-355f-476c-b416-b5bb1ec39e10 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:16.902557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa293ce-6fa7-431e-b35e-f8dc2447c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:16.903650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa293ce-6fa7-431e-b35e-f8dc2447c266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.904111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa293ce-6fa7-431e-b35e-f8dc2447c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.904355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa293ce-6fa7-431e-b35e-f8dc2447c266 admin admin] PATH_INFO: `/v3/projects/d06849d315f64a0391d41e1d9d02c7fe/users/691b63988b934fb18e70da5eb4de994f/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.940144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa293ce-6fa7-431e-b35e-f8dc2447c266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06849d315f64a0391d41e1d9d02c7fe, user_id=691b63988b934fb18e70da5eb4de994f, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:16.946222 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa293ce-6fa7-431e-b35e-f8dc2447c266 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:16.970730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 936/1861] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:19:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:16.972506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72e01a-91e1-4cd0-9adb-d7760af415a1 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:16.972896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72e01a-91e1-4cd0-9adb-d7760af415a1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:16.973837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72e01a-91e1-4cd0-9adb-d7760af415a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:16.974056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 926/1862] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:16 2022] PUT /identity/v3/projects/d06849d315f64a0391d41e1d9d02c7fe/users/691b63988b934fb18e70da5eb4de994f/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:16.974912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa293ce-6fa7-431e-b35e-f8dc2447c266 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:17.027328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cc72e01a-91e1-4cd0-9adb-d7760af415a1 None None] MFA Rules not processed for user `26e7f8e6fdc241f6a8cc425734d8eff0`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:17.028757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cc72e01a-91e1-4cd0-9adb-d7760af415a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:17.093922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa293ce-6fa7-431e-b35e-f8dc2447c266 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:17.115338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ca720-b717-4d21-a0df-fa31ff9c7a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:17.116064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ca720-b717-4d21-a0df-fa31ff9c7a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:17.116328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ca720-b717-4d21-a0df-fa31ff9c7a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:17.116601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ca720-b717-4d21-a0df-fa31ff9c7a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:17.121526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ca720-b717-4d21-a0df-fa31ff9c7a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:17.123196 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ca720-b717-4d21-a0df-fa31ff9c7a1a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:17.135297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 927/1863] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:17.139735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ca720-b717-4d21-a0df-fa31ff9c7a1a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:17.151954 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ca720-b717-4d21-a0df-fa31ff9c7a1a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:17.159045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb475e73-6916-4d3b-a895-468f05ef4908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:17.160097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb475e73-6916-4d3b-a895-468f05ef4908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:17.160431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb475e73-6916-4d3b-a895-468f05ef4908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:17.160740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb475e73-6916-4d3b-a895-468f05ef4908 admin admin] PATH_INFO: `/v3/projects/d06849d315f64a0391d41e1d9d02c7fe/users/691b63988b934fb18e70da5eb4de994f/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:17.162762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb475e73-6916-4d3b-a895-468f05ef4908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06849d315f64a0391d41e1d9d02c7fe, user_id=691b63988b934fb18e70da5eb4de994f, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:17.166104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb475e73-6916-4d3b-a895-468f05ef4908 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:17.191232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 928/1864] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:17 2022] PUT /identity/v3/projects/d06849d315f64a0391d41e1d9d02c7fe/users/691b63988b934fb18e70da5eb4de994f/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:17.205557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84087259-0b02-4611-ab05-ebb1b894b8d0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:17.205827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84087259-0b02-4611-ab05-ebb1b894b8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:17.206112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84087259-0b02-4611-ab05-ebb1b894b8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:17.214483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 937/1865] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:17.220644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72e01a-91e1-4cd0-9adb-d7760af415a1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:17.250476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72e01a-91e1-4cd0-9adb-d7760af415a1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:17.262172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:17.273137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-84087259-0b02-4611-ab05-ebb1b894b8d0 None None] MFA Rules not processed for user `691b63988b934fb18e70da5eb4de994f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:17.274475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-84087259-0b02-4611-ab05-ebb1b894b8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:17.370761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 929/1866] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:17.382195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84087259-0b02-4611-ab05-ebb1b894b8d0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:17.384596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-84087259-0b02-4611-ab05-ebb1b894b8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:17.481195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:17.506380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72531e6e-fe0d-46cc-8b30-6ff6a421f05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:17.507649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72531e6e-fe0d-46cc-8b30-6ff6a421f05b admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:17.508256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72531e6e-fe0d-46cc-8b30-6ff6a421f05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:17.508864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72531e6e-fe0d-46cc-8b30-6ff6a421f05b admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:17.509853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72531e6e-fe0d-46cc-8b30-6ff6a421f05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:17.512841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72531e6e-fe0d-46cc-8b30-6ff6a421f05b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:17.540123 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84087259-0b02-4611-ab05-ebb1b894b8d0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:17.549011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5095e3-7717-466a-b15c-f94c62182e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:17.549879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5095e3-7717-466a-b15c-f94c62182e31 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:17.550254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5095e3-7717-466a-b15c-f94c62182e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:17.551897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5095e3-7717-466a-b15c-f94c62182e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:17.569851 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5095e3-7717-466a-b15c-f94c62182e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:17.571769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5095e3-7717-466a-b15c-f94c62182e31 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:17.578300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 938/1867] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:17 2022] POST /identity/v3/projects => generated 381 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:17.581507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72531e6e-fe0d-46cc-8b30-6ff6a421f05b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:17.585463 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-72531e6e-fe0d-46cc-8b30-6ff6a421f05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:17.607501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 930/1868] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:17.611070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5095e3-7717-466a-b15c-f94c62182e31 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:17.630234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5095e3-7717-466a-b15c-f94c62182e31 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:17.806180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72531e6e-fe0d-46cc-8b30-6ff6a421f05b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:17.812979 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028e3ac-0b07-4beb-95a8-3b7de2ed7611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:17.813791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028e3ac-0b07-4beb-95a8-3b7de2ed7611 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:17.814171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028e3ac-0b07-4beb-95a8-3b7de2ed7611 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:17.814544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028e3ac-0b07-4beb-95a8-3b7de2ed7611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:17.814762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b66fd3-d1a3-4415-b426-f9ed3d22cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:17.817237 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b66fd3-d1a3-4415-b426-f9ed3d22cbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:17.817556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b66fd3-d1a3-4415-b426-f9ed3d22cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:17.818403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b66fd3-d1a3-4415-b426-f9ed3d22cbd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:17.819155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b66fd3-d1a3-4415-b426-f9ed3d22cbd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:17.827450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b66fd3-d1a3-4415-b426-f9ed3d22cbd5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:17.834825 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028e3ac-0b07-4beb-95a8-3b7de2ed7611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:17.849073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028e3ac-0b07-4beb-95a8-3b7de2ed7611 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:17.886456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 931/1869] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:17 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:17.891878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b66fd3-d1a3-4415-b426-f9ed3d22cbd5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:17.895684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 939/1870] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:17.903847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028e3ac-0b07-4beb-95a8-3b7de2ed7611 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:17.926260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028e3ac-0b07-4beb-95a8-3b7de2ed7611 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:17.943656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046c470-f955-43a4-9869-1e39bc8998fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:17.944903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046c470-f955-43a4-9869-1e39bc8998fc admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:17.945190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046c470-f955-43a4-9869-1e39bc8998fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:17.945463 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046c470-f955-43a4-9869-1e39bc8998fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:17.946352 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046c470-f955-43a4-9869-1e39bc8998fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:17.948401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046c470-f955-43a4-9869-1e39bc8998fc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:17.981930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 940/1871] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:17.984233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:17.987229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046c470-f955-43a4-9869-1e39bc8998fc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:18.013992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046c470-f955-43a4-9869-1e39bc8998fc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:18.031896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43d69-79b1-4e87-814e-a8e1d8cd441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:18.032960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43d69-79b1-4e87-814e-a8e1d8cd441a admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:18.033473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43d69-79b1-4e87-814e-a8e1d8cd441a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:18.033851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43d69-79b1-4e87-814e-a8e1d8cd441a admin admin] PATH_INFO: `/v3/projects/bbb3f1adcda142508c433a17cba8826f/users/3796ab5d20364c93966803b858e5a03c/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:18.039077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b66fd3-d1a3-4415-b426-f9ed3d22cbd5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:18.052376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d685f-a60e-494e-a52c-1129e45b054f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:18.054005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d685f-a60e-494e-a52c-1129e45b054f service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:18.054473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d685f-a60e-494e-a52c-1129e45b054f service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:18.055080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d685f-a60e-494e-a52c-1129e45b054f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:18.085086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc43d69-79b1-4e87-814e-a8e1d8cd441a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb3f1adcda142508c433a17cba8826f, user_id=3796ab5d20364c93966803b858e5a03c, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:18.101579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc43d69-79b1-4e87-814e-a8e1d8cd441a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:18.137996 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 941/1872] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:17 2022] PUT /identity/v3/projects/bbb3f1adcda142508c433a17cba8826f/users/3796ab5d20364c93966803b858e5a03c/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:18.139346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43d69-79b1-4e87-814e-a8e1d8cd441a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:18.182139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d685f-a60e-494e-a52c-1129e45b054f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:18.184935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d685f-a60e-494e-a52c-1129e45b054f service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:18.199155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 932/1873] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:18.262449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43d69-79b1-4e87-814e-a8e1d8cd441a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:18.268609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94307f-5a09-45b7-8a6e-91e258c0a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:18.270238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94307f-5a09-45b7-8a6e-91e258c0a328 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:18.270593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94307f-5a09-45b7-8a6e-91e258c0a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:18.271411 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94307f-5a09-45b7-8a6e-91e258c0a328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:18.272255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94307f-5a09-45b7-8a6e-91e258c0a328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:18.274928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94307f-5a09-45b7-8a6e-91e258c0a328 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:18.290358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 942/1874] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:18.294498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d685f-a60e-494e-a52c-1129e45b054f service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:18.311327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d685f-a60e-494e-a52c-1129e45b054f service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:18.318061 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4625cc-80e7-4f32-94a4-3119fb607374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:18.319218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4625cc-80e7-4f32-94a4-3119fb607374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:18.319565 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4625cc-80e7-4f32-94a4-3119fb607374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:18.319994 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4625cc-80e7-4f32-94a4-3119fb607374 admin admin] PATH_INFO: `/v3/projects/bbb3f1adcda142508c433a17cba8826f/users/3796ab5d20364c93966803b858e5a03c/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:18.322561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4625cc-80e7-4f32-94a4-3119fb607374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb3f1adcda142508c433a17cba8826f, user_id=3796ab5d20364c93966803b858e5a03c, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:18.327080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4625cc-80e7-4f32-94a4-3119fb607374 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:18.359153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936c4c3-b431-4a2c-b650-49d487ed6e03 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:18.359445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936c4c3-b431-4a2c-b650-49d487ed6e03 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:18.361961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936c4c3-b431-4a2c-b650-49d487ed6e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:18.366459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 933/1875] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:18 2022] PUT /identity/v3/projects/bbb3f1adcda142508c433a17cba8826f/users/3796ab5d20364c93966803b858e5a03c/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:18.423909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b936c4c3-b431-4a2c-b650-49d487ed6e03 None None] MFA Rules not processed for user `3796ab5d20364c93966803b858e5a03c`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:18.426147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b936c4c3-b431-4a2c-b650-49d487ed6e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:18.447638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:18.546983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 943/1876] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:18.577680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4625cc-80e7-4f32-94a4-3119fb607374 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:18.579411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3d4625cc-80e7-4f32-94a4-3119fb607374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:18.695981 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4625cc-80e7-4f32-94a4-3119fb607374 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:18.701612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c06702-981a-4eb4-870b-5534348ba2e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:18.702689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06702-981a-4eb4-870b-5534348ba2e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:18.703082 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06702-981a-4eb4-870b-5534348ba2e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:18.703397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c06702-981a-4eb4-870b-5534348ba2e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:18.714717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c06702-981a-4eb4-870b-5534348ba2e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:18.716174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c06702-981a-4eb4-870b-5534348ba2e7 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:18.750400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 934/1877] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:18.921792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936c4c3-b431-4a2c-b650-49d487ed6e03 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:18.936937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936c4c3-b431-4a2c-b650-49d487ed6e03 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:18.941388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6949c26-ce10-4cb6-a1df-241dca20f3d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:18.942888 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6949c26-ce10-4cb6-a1df-241dca20f3d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:18.943223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6949c26-ce10-4cb6-a1df-241dca20f3d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:18.943499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6949c26-ce10-4cb6-a1df-241dca20f3d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:19.023276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6949c26-ce10-4cb6-a1df-241dca20f3d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:19.025400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6949c26-ce10-4cb6-a1df-241dca20f3d5 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:19.035969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 944/1878] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:19.348801 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c06702-981a-4eb4-870b-5534348ba2e7 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:19.427013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c06702-981a-4eb4-870b-5534348ba2e7 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:19.433239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:19.434147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:19.434430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:19.434732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] PATH_INFO: `/v3/users/26e7f8e6fdc241f6a8cc425734d8eff0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:19.436032 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e7f8e6fdc241f6a8cc425734d8eff0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:19.438067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:19.455281 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:19.488780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e7f8e6fdc241f6a8cc425734d8eff0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:19.489448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e7f8e6fdc241f6a8cc425734d8eff0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:19.498097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e7f8e6fdc241f6a8cc425734d8eff0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:19.505087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e7f8e6fdc241f6a8cc425734d8eff0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:19.505723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e7f8e6fdc241f6a8cc425734d8eff0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:19.523122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 935/1879] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:19 2022] DELETE /identity/v3/users/26e7f8e6fdc241f6a8cc425734d8eff0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:19.528049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e50b5e-9682-42ee-b852-d45addc73a23 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:19.528384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e50b5e-9682-42ee-b852-d45addc73a23 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:19.528707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e50b5e-9682-42ee-b852-d45addc73a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:19.548371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e5e50b5e-9682-42ee-b852-d45addc73a23 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:19.549607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e5e50b5e-9682-42ee-b852-d45addc73a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:19.610859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 945/1880] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:19.620641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:19.622326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:19.684888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251da96-7c82-4a92-8446-6e89e0326b70 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:19.689119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c32bdb-db65-49c0-930c-a64ebd7bfcd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:19.689776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c32bdb-db65-49c0-930c-a64ebd7bfcd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:19.690057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c32bdb-db65-49c0-930c-a64ebd7bfcd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:19.690329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c32bdb-db65-49c0-930c-a64ebd7bfcd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:19.700707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c32bdb-db65-49c0-930c-a64ebd7bfcd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:19.702169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c32bdb-db65-49c0-930c-a64ebd7bfcd1 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:19.712052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 936/1881] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:20.001815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e50b5e-9682-42ee-b852-d45addc73a23 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:20.014967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e5e50b5e-9682-42ee-b852-d45addc73a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:20.033489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e50b5e-9682-42ee-b852-d45addc73a23 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:20.043508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:20.043508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:20.043508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:20.043508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] PATH_INFO: `/v3/projects/9515d697b12e43b1a1dfd664625459d2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:20.043852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9515d697b12e43b1a1dfd664625459d2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:20.044681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:20.130795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:20.133524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9515d697b12e43b1a1dfd664625459d2', 'request_id': 'req-8caebc03-78a2-49be-88dd-28a6545297c3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:20.142063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9515d697b12e43b1a1dfd664625459d2', 'request_id': 'req-8caebc03-78a2-49be-88dd-28a6545297c3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:20.159817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9515d697b12e43b1a1dfd664625459d2', 'request_id': 'req-8caebc03-78a2-49be-88dd-28a6545297c3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:20.182906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] The token cache is being invalidate because project 9515d697b12e43b1a1dfd664625459d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:20.183413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:20.184306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:20.186434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 946/1882] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:20 2022] DELETE /identity/v3/projects/9515d697b12e43b1a1dfd664625459d2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:20.190436 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c32bdb-db65-49c0-930c-a64ebd7bfcd1 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:20.202233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c32bdb-db65-49c0-930c-a64ebd7bfcd1 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:20.326761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:20.327670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:20.327939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:20.328252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] PATH_INFO: `/v3/users/3796ab5d20364c93966803b858e5a03c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:20.329484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3796ab5d20364c93966803b858e5a03c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:20.331519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:20.407266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:20.419483 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3796ab5d20364c93966803b858e5a03c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:20.420266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3796ab5d20364c93966803b858e5a03c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:20.430918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3796ab5d20364c93966803b858e5a03c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:20.439818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3796ab5d20364c93966803b858e5a03c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:20.440860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5f050789-ea7f-4530-b027-2a7398be9796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3796ab5d20364c93966803b858e5a03c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:20.467537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 937/1883] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:20 2022] DELETE /identity/v3/users/3796ab5d20364c93966803b858e5a03c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:20.871532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:20.873397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:20.887838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caebc03-78a2-49be-88dd-28a6545297c3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:20.964603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:20.965579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:20.965921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:20.966202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] PATH_INFO: `/v3/projects/bbb3f1adcda142508c433a17cba8826f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:20.967372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb3f1adcda142508c433a17cba8826f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:20.969341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:21.018177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb3f1adcda142508c433a17cba8826f', 'request_id': 'req-be4d6c0c-db06-4c49-a4ae-7600be54fee1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:21.023969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb3f1adcda142508c433a17cba8826f', 'request_id': 'req-be4d6c0c-db06-4c49-a4ae-7600be54fee1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:21.031880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb3f1adcda142508c433a17cba8826f', 'request_id': 'req-be4d6c0c-db06-4c49-a4ae-7600be54fee1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:21.043341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] The token cache is being invalidate because project bbb3f1adcda142508c433a17cba8826f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:21.043975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:21.044347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-be4d6c0c-db06-4c49-a4ae-7600be54fee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:21.045948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 947/1884] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:20 2022] DELETE /identity/v3/projects/bbb3f1adcda142508c433a17cba8826f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:21.052190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db3cab-2f70-4cda-a6d7-3fb9502d5a38 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.052695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db3cab-2f70-4cda-a6d7-3fb9502d5a38 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.052795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db3cab-2f70-4cda-a6d7-3fb9502d5a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.071977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-71db3cab-2f70-4cda-a6d7-3fb9502d5a38 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:21.073383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-71db3cab-2f70-4cda-a6d7-3fb9502d5a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:21.161325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 938/1885] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:21.162105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c3be-7990-452f-b351-dc2298891955 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.162409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c3be-7990-452f-b351-dc2298891955 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.162692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c3be-7990-452f-b351-dc2298891955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.197006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1d03c3be-7990-452f-b351-dc2298891955 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:21.198827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1d03c3be-7990-452f-b351-dc2298891955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:21.214013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db3cab-2f70-4cda-a6d7-3fb9502d5a38 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:21.217882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 948/1886] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:21.228821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db3cab-2f70-4cda-a6d7-3fb9502d5a38 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:21.238409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f669f4-c799-43ad-9a4e-d8cc89334a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:21.239711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f669f4-c799-43ad-9a4e-d8cc89334a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.240175 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f669f4-c799-43ad-9a4e-d8cc89334a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.241499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f669f4-c799-43ad-9a4e-d8cc89334a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.242591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f669f4-c799-43ad-9a4e-d8cc89334a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:21.243623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f669f4-c799-43ad-9a4e-d8cc89334a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:21.248854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f669f4-c799-43ad-9a4e-d8cc89334a6e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:21.272391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 939/1887] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:21.272735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03c3be-7990-452f-b351-dc2298891955 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:21.285183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03c3be-7990-452f-b351-dc2298891955 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:21.291183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b878a-4464-4230-b84a-f9a4586fd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:21.292119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b878a-4464-4230-b84a-f9a4586fd774 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.292253 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b878a-4464-4230-b84a-f9a4586fd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.292559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b878a-4464-4230-b84a-f9a4586fd774 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.293262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b878a-4464-4230-b84a-f9a4586fd774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:21.295244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b878a-4464-4230-b84a-f9a4586fd774 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:21.330748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 949/1888] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:21 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:21.343855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f669f4-c799-43ad-9a4e-d8cc89334a6e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:21.350983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b878a-4464-4230-b84a-f9a4586fd774 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:21.354569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-652b878a-4464-4230-b84a-f9a4586fd774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:21.374092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f669f4-c799-43ad-9a4e-d8cc89334a6e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:21.419520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:21.460853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b878a-4464-4230-b84a-f9a4586fd774 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:21.468377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:21.469602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.469913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.470305 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] PATH_INFO: `/v3/users/9cc02d10a6dc4bf5a8a82d68ad06e99d` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.471865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc02d10a6dc4bf5a8a82d68ad06e99d)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:21.474787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:21.497473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2dece-c565-4ad1-8a05-8edc77dd6e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:21.498209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2dece-c565-4ad1-8a05-8edc77dd6e6a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.498634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2dece-c565-4ad1-8a05-8edc77dd6e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.498924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2dece-c565-4ad1-8a05-8edc77dd6e6a admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.499665 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2dece-c565-4ad1-8a05-8edc77dd6e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:21.507308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2dece-c565-4ad1-8a05-8edc77dd6e6a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:21.548742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 940/1889] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:21 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:21.553059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2dece-c565-4ad1-8a05-8edc77dd6e6a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:21.559949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc02d10a6dc4bf5a8a82d68ad06e99d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:21.569274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2dece-c565-4ad1-8a05-8edc77dd6e6a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:21.571428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc02d10a6dc4bf5a8a82d68ad06e99d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:21.572088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc02d10a6dc4bf5a8a82d68ad06e99d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:21.576172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18608e7-9529-4b1b-a5c1-d1a6863331b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:21.576892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18608e7-9529-4b1b-a5c1-d1a6863331b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.577176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18608e7-9529-4b1b-a5c1-d1a6863331b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.577448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18608e7-9529-4b1b-a5c1-d1a6863331b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.578184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18608e7-9529-4b1b-a5c1-d1a6863331b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:21.579795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18608e7-9529-4b1b-a5c1-d1a6863331b7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:21.581830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc02d10a6dc4bf5a8a82d68ad06e99d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:21.584960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7f311256-a6ec-48d3-8421-3fd440a482ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc02d10a6dc4bf5a8a82d68ad06e99d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:21.593641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 941/1890] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:21.598062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18608e7-9529-4b1b-a5c1-d1a6863331b7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:21.599842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e18608e7-9529-4b1b-a5c1-d1a6863331b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:21.614726 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 950/1891] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:21 2022] DELETE /identity/v3/users/9cc02d10a6dc4bf5a8a82d68ad06e99d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:21.614913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18608e7-9529-4b1b-a5c1-d1a6863331b7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:21.616648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0fceb-dbaa-4d1b-a3d3-1e22aa119211 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.616961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0fceb-dbaa-4d1b-a3d3-1e22aa119211 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.617234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0fceb-dbaa-4d1b-a3d3-1e22aa119211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.637939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:21.638902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-29e0fceb-dbaa-4d1b-a3d3-1e22aa119211 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:21.641031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-29e0fceb-dbaa-4d1b-a3d3-1e22aa119211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:21.688823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd132437-9483-47e4-9bb5-293a319ac371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:21.689795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd132437-9483-47e4-9bb5-293a319ac371 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.690287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd132437-9483-47e4-9bb5-293a319ac371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.690875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd132437-9483-47e4-9bb5-293a319ac371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.692320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd132437-9483-47e4-9bb5-293a319ac371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:21.694678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd132437-9483-47e4-9bb5-293a319ac371 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:21.709786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 942/1892] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:21.714522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd132437-9483-47e4-9bb5-293a319ac371 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:21.721450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 951/1893] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:21.726239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd132437-9483-47e4-9bb5-293a319ac371 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:21.729013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0fceb-dbaa-4d1b-a3d3-1e22aa119211 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:21.730781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-29e0fceb-dbaa-4d1b-a3d3-1e22aa119211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:21.731867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040d75-13a0-4441-8741-aacbb1624673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:21.732912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040d75-13a0-4441-8741-aacbb1624673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.733151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040d75-13a0-4441-8741-aacbb1624673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.733359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040d75-13a0-4441-8741-aacbb1624673 admin admin] PATH_INFO: `/v3/projects/ddc156231d3e4ab4bab005393a094936/users/8a29cde5ba2b44e789a7477e21522c80/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.749988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040d75-13a0-4441-8741-aacbb1624673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc156231d3e4ab4bab005393a094936, user_id=8a29cde5ba2b44e789a7477e21522c80, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:21.752634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040d75-13a0-4441-8741-aacbb1624673 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:21.774822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 943/1894] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:21 2022] PUT /identity/v3/projects/ddc156231d3e4ab4bab005393a094936/users/8a29cde5ba2b44e789a7477e21522c80/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:21.790096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db631b-f8e8-44a4-ab6c-7d8ed09cee1f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.790381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db631b-f8e8-44a4-ab6c-7d8ed09cee1f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.790655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db631b-f8e8-44a4-ab6c-7d8ed09cee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.808479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0fceb-dbaa-4d1b-a3d3-1e22aa119211 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:21.817292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:21.823445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-73db631b-f8e8-44a4-ab6c-7d8ed09cee1f None None] MFA Rules not processed for user `8a29cde5ba2b44e789a7477e21522c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:21.824767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-73db631b-f8e8-44a4-ab6c-7d8ed09cee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:21.870433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fd025-b6a2-43f6-a020-8e03101dce43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:21.871090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fd025-b6a2-43f6-a020-8e03101dce43 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.871371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fd025-b6a2-43f6-a020-8e03101dce43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.871797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fd025-b6a2-43f6-a020-8e03101dce43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.903327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 944/1895] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:21.914558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db631b-f8e8-44a4-ab6c-7d8ed09cee1f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:21.948797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fd025-b6a2-43f6-a020-8e03101dce43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:21.950244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fd025-b6a2-43f6-a020-8e03101dce43 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:21.959932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 952/1896] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:21.986826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db631b-f8e8-44a4-ab6c-7d8ed09cee1f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:21.991587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f789e-c95b-4506-a172-60b40ba203af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:21.992259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f789e-c95b-4506-a172-60b40ba203af admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:21.992583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f789e-c95b-4506-a172-60b40ba203af admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:21.992928 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f789e-c95b-4506-a172-60b40ba203af admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:21.993655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f789e-c95b-4506-a172-60b40ba203af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:21.995563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f789e-c95b-4506-a172-60b40ba203af admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:22.037780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 945/1897] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:21 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:22.039020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fd025-b6a2-43f6-a020-8e03101dce43 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:22.058058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fd025-b6a2-43f6-a020-8e03101dce43 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:22.138029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89e8d1-7e6a-410e-8fb8-906003689293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:22.138910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89e8d1-7e6a-410e-8fb8-906003689293 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.139380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89e8d1-7e6a-410e-8fb8-906003689293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.139772 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89e8d1-7e6a-410e-8fb8-906003689293 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.140767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89e8d1-7e6a-410e-8fb8-906003689293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:22.143904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89e8d1-7e6a-410e-8fb8-906003689293 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:22.176259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 953/1898] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:22 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:22.180400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f789e-c95b-4506-a172-60b40ba203af admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:22.194084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f789e-c95b-4506-a172-60b40ba203af admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:22.216921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0ac2-ec9e-4d87-8e0c-ec1a519770fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:22.219027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0ac2-ec9e-4d87-8e0c-ec1a519770fc admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.219507 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0ac2-ec9e-4d87-8e0c-ec1a519770fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.220425 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0ac2-ec9e-4d87-8e0c-ec1a519770fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.221326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0ac2-ec9e-4d87-8e0c-ec1a519770fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:22.223754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0ac2-ec9e-4d87-8e0c-ec1a519770fc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:22.230514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:22.249354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89e8d1-7e6a-410e-8fb8-906003689293 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:22.250858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5e89e8d1-7e6a-410e-8fb8-906003689293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:22.258616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 946/1899] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:22.263258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0ac2-ec9e-4d87-8e0c-ec1a519770fc admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:22.267445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89e8d1-7e6a-410e-8fb8-906003689293 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:22.272911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:22.274603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.274987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.275358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] PATH_INFO: `/v3/users/7c74b5cb8471426b9aeaa875ef024bdb` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.276760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c74b5cb8471426b9aeaa875ef024bdb)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:22.279648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:22.292789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0ac2-ec9e-4d87-8e0c-ec1a519770fc admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:22.298584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fe119-ebea-45f7-bd9f-428853b52369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:22.299640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fe119-ebea-45f7-bd9f-428853b52369 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.300132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fe119-ebea-45f7-bd9f-428853b52369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.300619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fe119-ebea-45f7-bd9f-428853b52369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.301621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fe119-ebea-45f7-bd9f-428853b52369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:22.304853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fe119-ebea-45f7-bd9f-428853b52369 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:22.326883 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 947/1900] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:22.331126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fe119-ebea-45f7-bd9f-428853b52369 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:22.355223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fe119-ebea-45f7-bd9f-428853b52369 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:22.379138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:22.381122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8f171-7566-4745-ad1b-dd25289bd258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:22.381952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c74b5cb8471426b9aeaa875ef024bdb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:22.391267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8f171-7566-4745-ad1b-dd25289bd258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.392706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8f171-7566-4745-ad1b-dd25289bd258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.393726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8f171-7566-4745-ad1b-dd25289bd258 admin admin] PATH_INFO: `/v3/projects/ff747cb80b7545cdaaa3036b8cecbe9c/users/b2bf11d353eb4c1aa6839de4ada6aa56/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.396599 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c74b5cb8471426b9aeaa875ef024bdb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:22.397547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c74b5cb8471426b9aeaa875ef024bdb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:22.412112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c74b5cb8471426b9aeaa875ef024bdb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:22.413023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c74b5cb8471426b9aeaa875ef024bdb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:22.446338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8f171-7566-4745-ad1b-dd25289bd258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff747cb80b7545cdaaa3036b8cecbe9c, user_id=b2bf11d353eb4c1aa6839de4ada6aa56, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:22.449365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8f171-7566-4745-ad1b-dd25289bd258 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:22.462851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 954/1901] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:22 2022] DELETE /identity/v3/users/7c74b5cb8471426b9aeaa875ef024bdb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:22.465102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:22.484469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:22.489908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 948/1902] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:22 2022] PUT /identity/v3/projects/ff747cb80b7545cdaaa3036b8cecbe9c/users/b2bf11d353eb4c1aa6839de4ada6aa56/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:22.491624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565f57e-8d09-4342-851b-d36fb3c62633 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.492189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565f57e-8d09-4342-851b-d36fb3c62633 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.492473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565f57e-8d09-4342-851b-d36fb3c62633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.522142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1565f57e-8d09-4342-851b-d36fb3c62633 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:22.523709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1565f57e-8d09-4342-851b-d36fb3c62633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:22.616967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 949/1903] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:22.620332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cca15e-a9d4-4bec-8470-f3dbb976d354 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.620884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cca15e-a9d4-4bec-8470-f3dbb976d354 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.621400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cca15e-a9d4-4bec-8470-f3dbb976d354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.644398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7449-3c53-4984-8fa3-660ab99d294e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:22.652537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:22.654736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.655699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.656160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] PATH_INFO: `/v3/projects/a17b00c69d744b0c90dbae1ec7e06c5d` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.656499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-80cca15e-a9d4-4bec-8470-f3dbb976d354 None None] MFA Rules not processed for user `b2bf11d353eb4c1aa6839de4ada6aa56`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:22.657927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-80cca15e-a9d4-4bec-8470-f3dbb976d354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:22.658489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17b00c69d744b0c90dbae1ec7e06c5d)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:22.660841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:22.759831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17b00c69d744b0c90dbae1ec7e06c5d', 'request_id': 'req-03f5328e-4272-4807-bdc2-02ff87a57f67'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:22.767697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17b00c69d744b0c90dbae1ec7e06c5d', 'request_id': 'req-03f5328e-4272-4807-bdc2-02ff87a57f67'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:22.778826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17b00c69d744b0c90dbae1ec7e06c5d', 'request_id': 'req-03f5328e-4272-4807-bdc2-02ff87a57f67'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:22.785951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 950/1904] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:22.788018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cca15e-a9d4-4bec-8470-f3dbb976d354 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:22.789738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-80cca15e-a9d4-4bec-8470-f3dbb976d354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:22.809967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] The token cache is being invalidate because project a17b00c69d744b0c90dbae1ec7e06c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:22.810505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:22.811246 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:22.818081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 955/1905] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:22 2022] DELETE /identity/v3/projects/a17b00c69d744b0c90dbae1ec7e06c5d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:22.819364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:22.822269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:22.878556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cca15e-a9d4-4bec-8470-f3dbb976d354 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:22.886159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:22.903275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:22.917927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5328e-4272-4807-bdc2-02ff87a57f67 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:22.923803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a839c-a2c1-4b6c-88bd-25d71d159a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:22.924763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a839c-a2c1-4b6c-88bd-25d71d159a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.925066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a839c-a2c1-4b6c-88bd-25d71d159a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.925400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a839c-a2c1-4b6c-88bd-25d71d159a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.926156 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a839c-a2c1-4b6c-88bd-25d71d159a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:22.928053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a839c-a2c1-4b6c-88bd-25d71d159a52 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:22.962916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42d93f-9fd8-47d6-9d2b-ab88ebe71d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:22.964017 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42d93f-9fd8-47d6-9d2b-ab88ebe71d38 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.964498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42d93f-9fd8-47d6-9d2b-ab88ebe71d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.964948 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42d93f-9fd8-47d6-9d2b-ab88ebe71d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.967471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cc42d93f-9fd8-47d6-9d2b-ab88ebe71d38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:22.979711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 956/1906] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:22 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:22.979711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d71f5-a7b7-444e-8ad7-2d6ac32df260 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:22.979711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d71f5-a7b7-444e-8ad7-2d6ac32df260 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:22.979711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d71f5-a7b7-444e-8ad7-2d6ac32df260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:22.983463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42d93f-9fd8-47d6-9d2b-ab88ebe71d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:22.985703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42d93f-9fd8-47d6-9d2b-ab88ebe71d38 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:22.998978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 951/1907] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:22.999452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42d93f-9fd8-47d6-9d2b-ab88ebe71d38 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.002867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e65d71f5-a7b7-444e-8ad7-2d6ac32df260 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:23.004336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e65d71f5-a7b7-444e-8ad7-2d6ac32df260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:23.009971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42d93f-9fd8-47d6-9d2b-ab88ebe71d38 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.105225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 957/1908] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:23.115060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511340f-9156-4888-b8d4-a852ab4bbf20 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.116430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511340f-9156-4888-b8d4-a852ab4bbf20 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.118739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511340f-9156-4888-b8d4-a852ab4bbf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.133383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfbd6f-813c-443c-b556-801819871725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.133951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfbd6f-813c-443c-b556-801819871725 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.134244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfbd6f-813c-443c-b556-801819871725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.134580 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfbd6f-813c-443c-b556-801819871725 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.135392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfbd6f-813c-443c-b556-801819871725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.137888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfbd6f-813c-443c-b556-801819871725 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.167966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 952/1909] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:22 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:23.175549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7511340f-9156-4888-b8d4-a852ab4bbf20 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:23.176279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfbd6f-813c-443c-b556-801819871725 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.178818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7511340f-9156-4888-b8d4-a852ab4bbf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:23.201371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 958/1910] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:23.202245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfbd6f-813c-443c-b556-801819871725 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.203359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511340f-9156-4888-b8d4-a852ab4bbf20 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.215150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f56ca-8c56-4a13-83c8-3f65d170816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.217072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f56ca-8c56-4a13-83c8-3f65d170816a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.217473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f56ca-8c56-4a13-83c8-3f65d170816a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.220101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f56ca-8c56-4a13-83c8-3f65d170816a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.222546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f56ca-8c56-4a13-83c8-3f65d170816a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.233908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f56ca-8c56-4a13-83c8-3f65d170816a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.235807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511340f-9156-4888-b8d4-a852ab4bbf20 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.240595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd55084-1cdb-4522-b6ac-fd8849ae306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.241305 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd55084-1cdb-4522-b6ac-fd8849ae306f admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.241587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd55084-1cdb-4522-b6ac-fd8849ae306f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.241862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd55084-1cdb-4522-b6ac-fd8849ae306f admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.242658 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd55084-1cdb-4522-b6ac-fd8849ae306f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:23.242999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd55084-1cdb-4522-b6ac-fd8849ae306f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.244692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd55084-1cdb-4522-b6ac-fd8849ae306f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.250028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 953/1911] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:23.251069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f56ca-8c56-4a13-83c8-3f65d170816a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.260692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 959/1912] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:23.264318 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd55084-1cdb-4522-b6ac-fd8849ae306f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.288695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd55084-1cdb-4522-b6ac-fd8849ae306f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.291362 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f56ca-8c56-4a13-83c8-3f65d170816a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.304940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e93d-c77e-4325-8ed3-45752a753c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.305481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d6ea2-2e6b-4e7f-99c1-2bbbadab3f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.306260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d6ea2-2e6b-4e7f-99c1-2bbbadab3f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.306430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e93d-c77e-4325-8ed3-45752a753c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.306536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d6ea2-2e6b-4e7f-99c1-2bbbadab3f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.306833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d6ea2-2e6b-4e7f-99c1-2bbbadab3f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.307097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e93d-c77e-4325-8ed3-45752a753c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.307531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e93d-c77e-4325-8ed3-45752a753c31 admin admin] PATH_INFO: `/v3/projects/95dc411fd0914e4d928a28aac4fa78a1/users/86029c4cb0b7406493869efd7ee4c6bd/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.307659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d6ea2-2e6b-4e7f-99c1-2bbbadab3f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.310247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d6ea2-2e6b-4e7f-99c1-2bbbadab3f7d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.362426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 960/1913] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:23 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:23.366554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d6ea2-2e6b-4e7f-99c1-2bbbadab3f7d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.390001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e93d-c77e-4325-8ed3-45752a753c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95dc411fd0914e4d928a28aac4fa78a1, user_id=86029c4cb0b7406493869efd7ee4c6bd, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.393027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e93d-c77e-4325-8ed3-45752a753c31 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.419235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 954/1914] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:23 2022] PUT /identity/v3/projects/95dc411fd0914e4d928a28aac4fa78a1/users/86029c4cb0b7406493869efd7ee4c6bd/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:23.423023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e93d-c77e-4325-8ed3-45752a753c31 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.484780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d6ea2-2e6b-4e7f-99c1-2bbbadab3f7d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.538757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e93d-c77e-4325-8ed3-45752a753c31 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.544627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a20dc-be39-49d2-b138-28373e1849d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.545564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a20dc-be39-49d2-b138-28373e1849d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.545851 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a20dc-be39-49d2-b138-28373e1849d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.546125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a20dc-be39-49d2-b138-28373e1849d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.546859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a20dc-be39-49d2-b138-28373e1849d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.548880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a20dc-be39-49d2-b138-28373e1849d0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.557003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:23.565362 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 955/1915] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:23.566662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a20dc-be39-49d2-b138-28373e1849d0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.573710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:23.577641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9ed64-acdd-41bd-87ff-2b50e5269272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.578941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9ed64-acdd-41bd-87ff-2b50e5269272 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.579343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9ed64-acdd-41bd-87ff-2b50e5269272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.579704 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9ed64-acdd-41bd-87ff-2b50e5269272 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.580514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9ed64-acdd-41bd-87ff-2b50e5269272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.582745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9ed64-acdd-41bd-87ff-2b50e5269272 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.583266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a20dc-be39-49d2-b138-28373e1849d0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.591157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df6430-8af7-4cbe-9b38-6b50060f0cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.592442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df6430-8af7-4cbe-9b38-6b50060f0cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.592955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df6430-8af7-4cbe-9b38-6b50060f0cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.593605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df6430-8af7-4cbe-9b38-6b50060f0cfe admin admin] PATH_INFO: `/v3/projects/95dc411fd0914e4d928a28aac4fa78a1/users/86029c4cb0b7406493869efd7ee4c6bd/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.596969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df6430-8af7-4cbe-9b38-6b50060f0cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=95dc411fd0914e4d928a28aac4fa78a1, user_id=86029c4cb0b7406493869efd7ee4c6bd, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.600356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df6430-8af7-4cbe-9b38-6b50060f0cfe admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.607480 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 961/1916] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:23 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:23.611378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9ed64-acdd-41bd-87ff-2b50e5269272 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.625716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 956/1917] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:23 2022] PUT /identity/v3/projects/95dc411fd0914e4d928a28aac4fa78a1/users/86029c4cb0b7406493869efd7ee4c6bd/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:23.632215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9ed64-acdd-41bd-87ff-2b50e5269272 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.638155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7ff9b-5865-4ac2-b262-9703926913e8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.638486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7ff9b-5865-4ac2-b262-9703926913e8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.638764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7ff9b-5865-4ac2-b262-9703926913e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.688333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-14b7ff9b-5865-4ac2-b262-9703926913e8 None None] MFA Rules not processed for user `86029c4cb0b7406493869efd7ee4c6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:23.690524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-14b7ff9b-5865-4ac2-b262-9703926913e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:23.715858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa514-3931-41cf-846e-9a0d816a83b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.716553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa514-3931-41cf-846e-9a0d816a83b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.716881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa514-3931-41cf-846e-9a0d816a83b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.717187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa514-3931-41cf-846e-9a0d816a83b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.717929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fa514-3931-41cf-846e-9a0d816a83b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.719546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fa514-3931-41cf-846e-9a0d816a83b6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.730962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 962/1918] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:23.733592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa514-3931-41cf-846e-9a0d816a83b6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.735742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ab0fa514-3931-41cf-846e-9a0d816a83b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:23.749855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa514-3931-41cf-846e-9a0d816a83b6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.754491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.755367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.756171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.756171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] PATH_INFO: `/v3/projects/06bfb9df79d2444fa11c2cfc1774ded2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.757197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06bfb9df79d2444fa11c2cfc1774ded2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.759564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.769651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 957/1919] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:23.770554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7ff9b-5865-4ac2-b262-9703926913e8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.786098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7ff9b-5865-4ac2-b262-9703926913e8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.791724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7db2b-6f0d-4a68-b3bd-6909d2e6c57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.792414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7db2b-6f0d-4a68-b3bd-6909d2e6c57c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.792738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7db2b-6f0d-4a68-b3bd-6909d2e6c57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.793014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7db2b-6f0d-4a68-b3bd-6909d2e6c57c admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.793798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7db2b-6f0d-4a68-b3bd-6909d2e6c57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:23.795409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7db2b-6f0d-4a68-b3bd-6909d2e6c57c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:23.807974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 958/1920] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:23.808958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7db2b-6f0d-4a68-b3bd-6909d2e6c57c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.811595 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e9c7db2b-6f0d-4a68-b3bd-6909d2e6c57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:23.826164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06bfb9df79d2444fa11c2cfc1774ded2', 'request_id': 'req-e1d2bb5e-2481-4e17-87e0-56b034a090f1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:23.837394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06bfb9df79d2444fa11c2cfc1774ded2', 'request_id': 'req-e1d2bb5e-2481-4e17-87e0-56b034a090f1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:23.850792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06bfb9df79d2444fa11c2cfc1774ded2', 'request_id': 'req-e1d2bb5e-2481-4e17-87e0-56b034a090f1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:23.870088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] The token cache is being invalidate because project 06bfb9df79d2444fa11c2cfc1774ded2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:23.871976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:23.872736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:23.877984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 963/1921] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:23 2022] DELETE /identity/v3/projects/06bfb9df79d2444fa11c2cfc1774ded2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:23.878869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:23.880413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:23.888876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7db2b-6f0d-4a68-b3bd-6909d2e6c57c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.948032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:23.962133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b748652-ff88-4cea-8a73-fd91545c0646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.962397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748652-ff88-4cea-8a73-fd91545c0646 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.962859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748652-ff88-4cea-8a73-fd91545c0646 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.963203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748652-ff88-4cea-8a73-fd91545c0646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.966783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0b748652-ff88-4cea-8a73-fd91545c0646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:23.968324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2bb5e-2481-4e17-87e0-56b034a090f1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:23.974987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb847f3-3f8e-4fe8-a2d6-67b78ea2681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:23.975950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb847f3-3f8e-4fe8-a2d6-67b78ea2681f admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:23.976334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb847f3-3f8e-4fe8-a2d6-67b78ea2681f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:23.976621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb847f3-3f8e-4fe8-a2d6-67b78ea2681f admin admin] PATH_INFO: `/v3/projects/e426b79bc33a4efda9cd0d492ed51162/users/245dfa63a0e143889b43c3fa16530035/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:23.999600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb847f3-3f8e-4fe8-a2d6-67b78ea2681f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e426b79bc33a4efda9cd0d492ed51162, user_id=245dfa63a0e143889b43c3fa16530035, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:24.003556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb847f3-3f8e-4fe8-a2d6-67b78ea2681f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:24.023008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 964/1922] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:23 2022] PUT /identity/v3/projects/e426b79bc33a4efda9cd0d492ed51162/users/245dfa63a0e143889b43c3fa16530035/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:24.024019 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb847f3-3f8e-4fe8-a2d6-67b78ea2681f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:24.026094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-efb847f3-3f8e-4fe8-a2d6-67b78ea2681f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:24.050858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:24.104671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b748652-ff88-4cea-8a73-fd91545c0646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:24.106363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b748652-ff88-4cea-8a73-fd91545c0646 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:24.118875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 959/1923] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:24.120689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58865669-9404-4426-8902-1f16b34e0683 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:24.121045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58865669-9404-4426-8902-1f16b34e0683 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:24.135532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58865669-9404-4426-8902-1f16b34e0683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:24.171451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb847f3-3f8e-4fe8-a2d6-67b78ea2681f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:24.177856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:24.179013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:24.179369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:24.179679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] PATH_INFO: `/v3/users/691b63988b934fb18e70da5eb4de994f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:24.181786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691b63988b934fb18e70da5eb4de994f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:24.183747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:24.198990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-58865669-9404-4426-8902-1f16b34e0683 None None] MFA Rules not processed for user `245dfa63a0e143889b43c3fa16530035`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:24.200594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-58865669-9404-4426-8902-1f16b34e0683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:24.298207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691b63988b934fb18e70da5eb4de994f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:24.326682 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691b63988b934fb18e70da5eb4de994f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:24.327346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691b63988b934fb18e70da5eb4de994f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:24.338243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691b63988b934fb18e70da5eb4de994f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:24.339622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691b63988b934fb18e70da5eb4de994f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:24.352555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 960/1924] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:24.366226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58865669-9404-4426-8902-1f16b34e0683 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:24.367982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-58865669-9404-4426-8902-1f16b34e0683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:24.387688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 965/1925] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:24 2022] DELETE /identity/v3/users/691b63988b934fb18e70da5eb4de994f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:24.533157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58865669-9404-4426-8902-1f16b34e0683 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:24.662282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4569594-c5c6-4d5d-81ec-084feb3b0332 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf4ab9d717e4c838d68590336074f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:24.663478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4569594-c5c6-4d5d-81ec-084feb3b0332 service glance] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:24.663770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4569594-c5c6-4d5d-81ec-084feb3b0332 service glance] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:24.664053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4569594-c5c6-4d5d-81ec-084feb3b0332 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:24.707886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:24.769912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4569594-c5c6-4d5d-81ec-084feb3b0332 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:24.771490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4569594-c5c6-4d5d-81ec-084feb3b0332 service glance] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:24.796382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 961/1926] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:24.805826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:24.807283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:24.913366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:24.917759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61e15f-6a52-4148-9662-2ab39b6aaec2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:24.929634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:24.930910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:24.931356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:24.931652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] PATH_INFO: `/v3/projects/d06849d315f64a0391d41e1d9d02c7fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:24.933416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06849d315f64a0391d41e1d9d02c7fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:24.935390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:24.985692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06849d315f64a0391d41e1d9d02c7fe', 'request_id': 'req-79ab5dae-c9bb-4464-8233-4cb0fed26a58'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:24.994720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06849d315f64a0391d41e1d9d02c7fe', 'request_id': 'req-79ab5dae-c9bb-4464-8233-4cb0fed26a58'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:25.003878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06849d315f64a0391d41e1d9d02c7fe', 'request_id': 'req-79ab5dae-c9bb-4464-8233-4cb0fed26a58'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:25.015759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] The token cache is being invalidate because project d06849d315f64a0391d41e1d9d02c7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:25.016076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:25.017150 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-79ab5dae-c9bb-4464-8233-4cb0fed26a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:25.018712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 966/1927] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:24 2022] DELETE /identity/v3/projects/d06849d315f64a0391d41e1d9d02c7fe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:25.023683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902641b2-5541-45ac-9998-df7c908cd1c9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:25.024033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902641b2-5541-45ac-9998-df7c908cd1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:25.024343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902641b2-5541-45ac-9998-df7c908cd1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:25.043167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-902641b2-5541-45ac-9998-df7c908cd1c9 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:25.044581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-902641b2-5541-45ac-9998-df7c908cd1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:25.115250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 962/1928] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:25.123927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9830359-7904-47d1-831a-7482d107fb5c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:25.124980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9830359-7904-47d1-831a-7482d107fb5c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:25.125285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9830359-7904-47d1-831a-7482d107fb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:25.148993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a9830359-7904-47d1-831a-7482d107fb5c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:25.150554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a9830359-7904-47d1-831a-7482d107fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:25.160125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 967/1929] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:25.164584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902641b2-5541-45ac-9998-df7c908cd1c9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:25.176575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902641b2-5541-45ac-9998-df7c908cd1c9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:25.182915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c6b65-8501-4adb-a200-64cbaceb6575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:25.183741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c6b65-8501-4adb-a200-64cbaceb6575 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:25.184222 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c6b65-8501-4adb-a200-64cbaceb6575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:25.184614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c6b65-8501-4adb-a200-64cbaceb6575 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:25.185738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c6b65-8501-4adb-a200-64cbaceb6575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:25.185898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c6b65-8501-4adb-a200-64cbaceb6575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:25.188108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c6b65-8501-4adb-a200-64cbaceb6575 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:25.201546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 963/1930] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:25.205827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9830359-7904-47d1-831a-7482d107fb5c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:25.217303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9830359-7904-47d1-831a-7482d107fb5c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:25.224647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e219f0f-0ea8-475f-8acd-64be4b637f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:25.225591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219f0f-0ea8-475f-8acd-64be4b637f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:25.226251 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219f0f-0ea8-475f-8acd-64be4b637f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:25.226687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219f0f-0ea8-475f-8acd-64be4b637f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:25.227750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e219f0f-0ea8-475f-8acd-64be4b637f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:25.231957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e219f0f-0ea8-475f-8acd-64be4b637f5d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:25.270626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 968/1931] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:25 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:25.274961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c6b65-8501-4adb-a200-64cbaceb6575 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:25.287891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c6b65-8501-4adb-a200-64cbaceb6575 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:25.399989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4992c-54bf-47e8-918b-1291d4980d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:25.400817 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4992c-54bf-47e8-918b-1291d4980d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:25.401169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4992c-54bf-47e8-918b-1291d4980d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:25.401538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4992c-54bf-47e8-918b-1291d4980d74 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:25.402483 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4992c-54bf-47e8-918b-1291d4980d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:25.404808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4992c-54bf-47e8-918b-1291d4980d74 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:25.450984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 964/1932] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:25 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:25.451667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e219f0f-0ea8-475f-8acd-64be4b637f5d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:25.466555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e219f0f-0ea8-475f-8acd-64be4b637f5d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:25.473138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fc327-2bb0-465f-a512-463dc3d22e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:25.473927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fc327-2bb0-465f-a512-463dc3d22e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:25.474325 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fc327-2bb0-465f-a512-463dc3d22e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:25.474723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fc327-2bb0-465f-a512-463dc3d22e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:25.475546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fc327-2bb0-465f-a512-463dc3d22e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:25.477484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fc327-2bb0-465f-a512-463dc3d22e2d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:25.489548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 969/1933] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:25.493820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4992c-54bf-47e8-918b-1291d4980d74 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:25.504184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4992c-54bf-47e8-918b-1291d4980d74 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:25.509599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953fb5c-4853-45e3-ad59-2dc5fc34005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:25.510323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fb5c-4853-45e3-ad59-2dc5fc34005c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:25.510604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fb5c-4853-45e3-ad59-2dc5fc34005c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:25.510913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fb5c-4853-45e3-ad59-2dc5fc34005c admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:25.511898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953fb5c-4853-45e3-ad59-2dc5fc34005c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:25.513669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953fb5c-4853-45e3-ad59-2dc5fc34005c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:25.525230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 965/1934] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:25.529652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fc327-2bb0-465f-a512-463dc3d22e2d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:25.541934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fc327-2bb0-465f-a512-463dc3d22e2d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:25.546763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d8d2a-2c5a-41ce-bafb-a06fe0edfce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:25.547736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d8d2a-2c5a-41ce-bafb-a06fe0edfce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:25.548018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d8d2a-2c5a-41ce-bafb-a06fe0edfce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:25.548289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d8d2a-2c5a-41ce-bafb-a06fe0edfce2 admin admin] PATH_INFO: `/v3/projects/f862d331ca3344b1be58cb9c2ca94856/users/81955a58e5c44872a5fe873f8482f3d3/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:25.565067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d8d2a-2c5a-41ce-bafb-a06fe0edfce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f862d331ca3344b1be58cb9c2ca94856, user_id=81955a58e5c44872a5fe873f8482f3d3, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:25.567729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d8d2a-2c5a-41ce-bafb-a06fe0edfce2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:25.583917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 970/1935] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:25 2022] PUT /identity/v3/projects/f862d331ca3344b1be58cb9c2ca94856/users/81955a58e5c44872a5fe873f8482f3d3/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:25.594130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1f6a-2741-420b-88e4-c2151e648b50 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:25.594788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1f6a-2741-420b-88e4-c2151e648b50 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:25.595076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1f6a-2741-420b-88e4-c2151e648b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:25.631476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b6ba1f6a-2741-420b-88e4-c2151e648b50 None None] MFA Rules not processed for user `81955a58e5c44872a5fe873f8482f3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:25.632828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b6ba1f6a-2741-420b-88e4-c2151e648b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:25.643765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:25.744179 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 966/1936] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:25.748591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d8d2a-2c5a-41ce-bafb-a06fe0edfce2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:25.838826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d8d2a-2c5a-41ce-bafb-a06fe0edfce2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:25.843632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811479fc-9189-4c59-808c-a740ca70bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:25.844304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811479fc-9189-4c59-808c-a740ca70bb8c admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:25.844587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811479fc-9189-4c59-808c-a740ca70bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:25.844904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811479fc-9189-4c59-808c-a740ca70bb8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:25.845584 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811479fc-9189-4c59-808c-a740ca70bb8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:25.850097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811479fc-9189-4c59-808c-a740ca70bb8c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:25.886919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 971/1937] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:25 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:25.891479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba1f6a-2741-420b-88e4-c2151e648b50 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:25.920520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba1f6a-2741-420b-88e4-c2151e648b50 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:25.933075 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811479fc-9189-4c59-808c-a740ca70bb8c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:25.938299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-811479fc-9189-4c59-808c-a740ca70bb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:25.952183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:26.021076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ee15d-c11c-4d1e-8512-059b307e5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:26.021076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ee15d-c11c-4d1e-8512-059b307e5e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:26.021076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ee15d-c11c-4d1e-8512-059b307e5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:26.021076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ee15d-c11c-4d1e-8512-059b307e5e59 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:26.021634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ee15d-c11c-4d1e-8512-059b307e5e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:26.021634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ee15d-c11c-4d1e-8512-059b307e5e59 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:26.069487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 967/1938] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:25 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:26.074174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ee15d-c11c-4d1e-8512-059b307e5e59 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:26.089369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811479fc-9189-4c59-808c-a740ca70bb8c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:26.093037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dbea4-4e5f-44a3-b39a-4b03ec2e8260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:26.093830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dbea4-4e5f-44a3-b39a-4b03ec2e8260 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:26.094112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dbea4-4e5f-44a3-b39a-4b03ec2e8260 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:26.094548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dbea4-4e5f-44a3-b39a-4b03ec2e8260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:26.096348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0c1dbea4-4e5f-44a3-b39a-4b03ec2e8260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:26.103218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ee15d-c11c-4d1e-8512-059b307e5e59 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:26.114086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22244d31-7ec1-49ab-a5d8-3182e340b990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:26.115358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22244d31-7ec1-49ab-a5d8-3182e340b990 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:26.115986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22244d31-7ec1-49ab-a5d8-3182e340b990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:26.116555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22244d31-7ec1-49ab-a5d8-3182e340b990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:26.118438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22244d31-7ec1-49ab-a5d8-3182e340b990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:26.121810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22244d31-7ec1-49ab-a5d8-3182e340b990 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:26.148740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 968/1939] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:26.152593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22244d31-7ec1-49ab-a5d8-3182e340b990 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:26.182866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22244d31-7ec1-49ab-a5d8-3182e340b990 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:26.198283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dbea4-4e5f-44a3-b39a-4b03ec2e8260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:26.199334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b9617-44e3-47d4-b48d-064acf6a9721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:26.200036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b9617-44e3-47d4-b48d-064acf6a9721 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:26.200318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b9617-44e3-47d4-b48d-064acf6a9721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:26.200512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dbea4-4e5f-44a3-b39a-4b03ec2e8260 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:26.200628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b9617-44e3-47d4-b48d-064acf6a9721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:26.201388 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b9617-44e3-47d4-b48d-064acf6a9721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:26.202993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b9617-44e3-47d4-b48d-064acf6a9721 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:26.212314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 972/1940] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:26.222885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 969/1941] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:26.226217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dbea4-4e5f-44a3-b39a-4b03ec2e8260 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:26.242190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dbea4-4e5f-44a3-b39a-4b03ec2e8260 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:26.254778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024f6f5-f925-44d0-a00f-c0ee8dc80bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:26.256465 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024f6f5-f925-44d0-a00f-c0ee8dc80bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:26.256992 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024f6f5-f925-44d0-a00f-c0ee8dc80bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:26.257644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024f6f5-f925-44d0-a00f-c0ee8dc80bbb admin admin] PATH_INFO: `/v3/projects/9150718264e740609afc0c5e24aafe0d/users/9d2836d4e6574e969db66438f0578575/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:26.275919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024f6f5-f925-44d0-a00f-c0ee8dc80bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9150718264e740609afc0c5e24aafe0d, user_id=9d2836d4e6574e969db66438f0578575, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:26.279094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024f6f5-f925-44d0-a00f-c0ee8dc80bbb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:26.304742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 973/1942] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:26 2022] PUT /identity/v3/projects/9150718264e740609afc0c5e24aafe0d/users/9d2836d4e6574e969db66438f0578575/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:26.312395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595e324-55ca-4382-b201-f432bc02fd4c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:26.312771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595e324-55ca-4382-b201-f432bc02fd4c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:26.312955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595e324-55ca-4382-b201-f432bc02fd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:26.376491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4595e324-55ca-4382-b201-f432bc02fd4c None None] MFA Rules not processed for user `9d2836d4e6574e969db66438f0578575`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:26.378415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4595e324-55ca-4382-b201-f432bc02fd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:26.493289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 970/1943] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:26.495464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024f6f5-f925-44d0-a00f-c0ee8dc80bbb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:26.617731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024f6f5-f925-44d0-a00f-c0ee8dc80bbb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:26.640790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50988f-3595-423d-ac84-52cf2c6b2bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:26.641561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50988f-3595-423d-ac84-52cf2c6b2bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:26.641771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50988f-3595-423d-ac84-52cf2c6b2bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:26.644582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50988f-3595-423d-ac84-52cf2c6b2bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:26.646564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50988f-3595-423d-ac84-52cf2c6b2bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:26.650602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50988f-3595-423d-ac84-52cf2c6b2bb8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:26.727737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 974/1944] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:26 2022] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:26.732228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595e324-55ca-4382-b201-f432bc02fd4c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:26.743374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595e324-55ca-4382-b201-f432bc02fd4c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:26.748261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:26.830008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a42182-2ccc-4a44-a242-04a63284e0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:26.831271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a42182-2ccc-4a44-a242-04a63284e0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:26.831500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a42182-2ccc-4a44-a242-04a63284e0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:26.831751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a42182-2ccc-4a44-a242-04a63284e0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:26.832640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a42182-2ccc-4a44-a242-04a63284e0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:26.835043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a42182-2ccc-4a44-a242-04a63284e0e8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:26.859251 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 971/1945] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:26 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:26.868959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50988f-3595-423d-ac84-52cf2c6b2bb8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:26.884043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50988f-3595-423d-ac84-52cf2c6b2bb8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:26.890064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323380ea-c85d-43d0-82c6-28e946417cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:26.890803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323380ea-c85d-43d0-82c6-28e946417cac admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:26.891090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323380ea-c85d-43d0-82c6-28e946417cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:26.891370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323380ea-c85d-43d0-82c6-28e946417cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:26.892629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323380ea-c85d-43d0-82c6-28e946417cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:26.894394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323380ea-c85d-43d0-82c6-28e946417cac admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:26.909953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 975/1946] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:26.911038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a42182-2ccc-4a44-a242-04a63284e0e8 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:26.925706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a42182-2ccc-4a44-a242-04a63284e0e8 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:26.932113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905732ed-bd24-461a-bcf5-51a696013f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:26.933422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905732ed-bd24-461a-bcf5-51a696013f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:26.933422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905732ed-bd24-461a-bcf5-51a696013f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:26.933663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905732ed-bd24-461a-bcf5-51a696013f2a admin admin] PATH_INFO: `/v3/projects/598b8f4c733b4db4809f0a78202eae5b/users/7e209280e6f94e5f84ddb90d60801d31/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:26.956412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905732ed-bd24-461a-bcf5-51a696013f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=598b8f4c733b4db4809f0a78202eae5b, user_id=7e209280e6f94e5f84ddb90d60801d31, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:26.956412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905732ed-bd24-461a-bcf5-51a696013f2a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:26.970603 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 972/1947] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:26 2022] PUT /identity/v3/projects/598b8f4c733b4db4809f0a78202eae5b/users/7e209280e6f94e5f84ddb90d60801d31/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:26.974885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323380ea-c85d-43d0-82c6-28e946417cac admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:26.985990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323380ea-c85d-43d0-82c6-28e946417cac admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:26.996734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:27.055424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4a15-fc11-488d-8c19-886d62752741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:27.056254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4a15-fc11-488d-8c19-886d62752741 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:27.056620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4a15-fc11-488d-8c19-886d62752741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:27.057014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4a15-fc11-488d-8c19-886d62752741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:27.060293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a4a15-fc11-488d-8c19-886d62752741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:27.062105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a4a15-fc11-488d-8c19-886d62752741 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:27.077287 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 976/1948] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:27.078986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905732ed-bd24-461a-bcf5-51a696013f2a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:27.093646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905732ed-bd24-461a-bcf5-51a696013f2a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:27.101177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4a15-fc11-488d-8c19-886d62752741 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:27.109348 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9b6bb-62ab-4bcf-a416-4d5b25796c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:27.110315 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9b6bb-62ab-4bcf-a416-4d5b25796c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:27.110617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9b6bb-62ab-4bcf-a416-4d5b25796c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:27.110895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9b6bb-62ab-4bcf-a416-4d5b25796c87 admin admin] PATH_INFO: `/v3/projects/598b8f4c733b4db4809f0a78202eae5b/users/7e209280e6f94e5f84ddb90d60801d31/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:27.112977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9b6bb-62ab-4bcf-a416-4d5b25796c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598b8f4c733b4db4809f0a78202eae5b, user_id=7e209280e6f94e5f84ddb90d60801d31, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:27.115771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9b6bb-62ab-4bcf-a416-4d5b25796c87 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:27.127686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 973/1949] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:27 2022] PUT /identity/v3/projects/598b8f4c733b4db4809f0a78202eae5b/users/7e209280e6f94e5f84ddb90d60801d31/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:27.141085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bc08d-f44f-477b-ad2e-452a9df21511 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:27.141085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bc08d-f44f-477b-ad2e-452a9df21511 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:27.141085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bc08d-f44f-477b-ad2e-452a9df21511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:27.170116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4a15-fc11-488d-8c19-886d62752741 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:27.170550 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c75bc08d-f44f-477b-ad2e-452a9df21511 None None] MFA Rules not processed for user `7e209280e6f94e5f84ddb90d60801d31`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:27.172692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c75bc08d-f44f-477b-ad2e-452a9df21511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:27.241203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f0c1f-60e4-4a27-a050-7c293ae22bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:27.241864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f0c1f-60e4-4a27-a050-7c293ae22bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:27.242153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f0c1f-60e4-4a27-a050-7c293ae22bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:27.242441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f0c1f-60e4-4a27-a050-7c293ae22bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:27.244984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f30f0c1f-60e4-4a27-a050-7c293ae22bd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:27.261211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 974/1950] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:27.272578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bc08d-f44f-477b-ad2e-452a9df21511 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:27.273957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c75bc08d-f44f-477b-ad2e-452a9df21511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:27.286580 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bc08d-f44f-477b-ad2e-452a9df21511 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:27.291007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8cdf-134c-4a4b-9b01-d4f4f80a0f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:27.291674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8cdf-134c-4a4b-9b01-d4f4f80a0f32 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:27.291960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8cdf-134c-4a4b-9b01-d4f4f80a0f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:27.292236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8cdf-134c-4a4b-9b01-d4f4f80a0f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:27.301942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d8cdf-134c-4a4b-9b01-d4f4f80a0f32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:27.303467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d8cdf-134c-4a4b-9b01-d4f4f80a0f32 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:27.311909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f0c1f-60e4-4a27-a050-7c293ae22bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:27.313407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f0c1f-60e4-4a27-a050-7c293ae22bd8 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:27.314398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 975/1951] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:27.323937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 977/1952] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:27.357216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8cdf-134c-4a4b-9b01-d4f4f80a0f32 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:27.372755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8cdf-134c-4a4b-9b01-d4f4f80a0f32 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:27.377330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776904c-224c-41d9-8423-952c9c220884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:27.378165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776904c-224c-41d9-8423-952c9c220884 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:27.378373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776904c-224c-41d9-8423-952c9c220884 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:27.378696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776904c-224c-41d9-8423-952c9c220884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:27.411923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:27.442343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776904c-224c-41d9-8423-952c9c220884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:27.443773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776904c-224c-41d9-8423-952c9c220884 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:27.453611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 976/1953] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:30.511407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f0c1f-60e4-4a27-a050-7c293ae22bd8 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:30.527319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:30.592098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f0c1f-60e4-4a27-a050-7c293ae22bd8 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:30.597672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:30.598906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:30.599330 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:30.599809 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] PATH_INFO: `/v3/users/81955a58e5c44872a5fe873f8482f3d3` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:30.601212 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81955a58e5c44872a5fe873f8482f3d3)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:30.603606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:30.667297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81955a58e5c44872a5fe873f8482f3d3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:30.679948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81955a58e5c44872a5fe873f8482f3d3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:30.680974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81955a58e5c44872a5fe873f8482f3d3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:30.690674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81955a58e5c44872a5fe873f8482f3d3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:30.691567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81955a58e5c44872a5fe873f8482f3d3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:30.717715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 978/1954] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:30 2022] DELETE /identity/v3/users/81955a58e5c44872a5fe873f8482f3d3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:30.725686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520d2b4-34e5-4886-aeab-cb53f14c0e2b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:30.726148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520d2b4-34e5-4886-aeab-cb53f14c0e2b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:30.727177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520d2b4-34e5-4886-aeab-cb53f14c0e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:30.749746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a520d2b4-34e5-4886-aeab-cb53f14c0e2b None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:30.751101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a520d2b4-34e5-4886-aeab-cb53f14c0e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:30.829520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 977/1955] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:30.839324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:30.840947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:30.904547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8665d-f702-4bc4-82be-24e2f326d9e8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:30.908187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf94ca0-14e0-492d-8099-c65dc17ed970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:30.908961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94ca0-14e0-492d-8099-c65dc17ed970 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:30.909267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94ca0-14e0-492d-8099-c65dc17ed970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:30.909556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94ca0-14e0-492d-8099-c65dc17ed970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:30.919485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf94ca0-14e0-492d-8099-c65dc17ed970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:30.920949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf94ca0-14e0-492d-8099-c65dc17ed970 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:30.931437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 979/1956] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:31.306915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520d2b4-34e5-4886-aeab-cb53f14c0e2b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:31.308743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a520d2b4-34e5-4886-aeab-cb53f14c0e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:31.322713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520d2b4-34e5-4886-aeab-cb53f14c0e2b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:31.329285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:31.330543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:31.330914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:31.331319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] PATH_INFO: `/v3/users/8a29cde5ba2b44e789a7477e21522c80` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:31.332796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a29cde5ba2b44e789a7477e21522c80)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:31.335310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:31.408508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a29cde5ba2b44e789a7477e21522c80'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:31.409229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a29cde5ba2b44e789a7477e21522c80'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:31.419256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a29cde5ba2b44e789a7477e21522c80'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:31.428526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a29cde5ba2b44e789a7477e21522c80'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:31.429559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a29cde5ba2b44e789a7477e21522c80'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:31.457330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 978/1957] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:31 2022] DELETE /identity/v3/users/8a29cde5ba2b44e789a7477e21522c80 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:31.458801 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f8341-078b-4fb0-a472-6ac4857a848f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:31.459570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f8341-078b-4fb0-a472-6ac4857a848f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:31.459857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f8341-078b-4fb0-a472-6ac4857a848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:31.485034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0b7f8341-078b-4fb0-a472-6ac4857a848f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:31.485720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0b7f8341-078b-4fb0-a472-6ac4857a848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:31.534849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:31.573914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 980/1958] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:31.585143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:31.588701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:31.649899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:31.665408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec7b4b-a5bc-491b-b124-fe79ff265916 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:31.671409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74cd8b-2da7-452e-a0ef-5d244d1da4ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:31.672040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74cd8b-2da7-452e-a0ef-5d244d1da4ae service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:31.673444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74cd8b-2da7-452e-a0ef-5d244d1da4ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:31.673444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74cd8b-2da7-452e-a0ef-5d244d1da4ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:31.686873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74cd8b-2da7-452e-a0ef-5d244d1da4ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:31.688488 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74cd8b-2da7-452e-a0ef-5d244d1da4ae service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:31.707590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 979/1959] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:31.716139 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f8341-078b-4fb0-a472-6ac4857a848f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:31.717908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0b7f8341-078b-4fb0-a472-6ac4857a848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:31.735969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f8341-078b-4fb0-a472-6ac4857a848f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:31.741413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:31.742536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:31.742973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:31.743316 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] PATH_INFO: `/v3/projects/f862d331ca3344b1be58cb9c2ca94856` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:31.744737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f862d331ca3344b1be58cb9c2ca94856)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:31.746883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:31.858186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f862d331ca3344b1be58cb9c2ca94856', 'request_id': 'req-df2d5679-c132-43d2-b34f-b9976e187036'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:31.868187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f862d331ca3344b1be58cb9c2ca94856', 'request_id': 'req-df2d5679-c132-43d2-b34f-b9976e187036'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:31.881445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f862d331ca3344b1be58cb9c2ca94856', 'request_id': 'req-df2d5679-c132-43d2-b34f-b9976e187036'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:31.896032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] The token cache is being invalidate because project f862d331ca3344b1be58cb9c2ca94856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:31.896339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:31.897023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:31.898776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 981/1960] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:31 2022] DELETE /identity/v3/projects/f862d331ca3344b1be58cb9c2ca94856 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:31.902608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74cd8b-2da7-452e-a0ef-5d244d1da4ae service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:31.923496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74cd8b-2da7-452e-a0ef-5d244d1da4ae service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:31.999669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:32.000643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:32.001043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:32.002178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] PATH_INFO: `/v3/users/9d2836d4e6574e969db66438f0578575` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:32.003468 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2836d4e6574e969db66438f0578575)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:32.005454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:32.055414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2836d4e6574e969db66438f0578575'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.056450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2836d4e6574e969db66438f0578575'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.069983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2836d4e6574e969db66438f0578575'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.079836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2836d4e6574e969db66438f0578575'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.081076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2836d4e6574e969db66438f0578575'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.099783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 980/1961] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:31 2022] DELETE /identity/v3/users/9d2836d4e6574e969db66438f0578575 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:32.197364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:32.201819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:32.247555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d5679-c132-43d2-b34f-b9976e187036 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:32.320247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:32.321444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:32.321799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:32.322183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] PATH_INFO: `/v3/projects/ddc156231d3e4ab4bab005393a094936` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:32.323451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc156231d3e4ab4bab005393a094936)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:32.325506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:32.382941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc156231d3e4ab4bab005393a094936', 'request_id': 'req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.389494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc156231d3e4ab4bab005393a094936', 'request_id': 'req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.392850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:32.399165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc156231d3e4ab4bab005393a094936', 'request_id': 'req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.414348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] The token cache is being invalidate because project ddc156231d3e4ab4bab005393a094936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:32.414636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.415455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.417155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 982/1962] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:32 2022] DELETE /identity/v3/projects/ddc156231d3e4ab4bab005393a094936 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:32.421409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:32.422845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:32.436190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe75e-cfa6-46ef-9df8-c32f8802a0d3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:32.499334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:32.501182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:32.501474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:32.501750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] PATH_INFO: `/v3/users/b2bf11d353eb4c1aa6839de4ada6aa56` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:32.502992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2bf11d353eb4c1aa6839de4ada6aa56)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:32.504954 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:32.510912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:32.564947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2bf11d353eb4c1aa6839de4ada6aa56'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.565667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2bf11d353eb4c1aa6839de4ada6aa56'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.574767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2bf11d353eb4c1aa6839de4ada6aa56'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.583989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2bf11d353eb4c1aa6839de4ada6aa56'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.584738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2bf11d353eb4c1aa6839de4ada6aa56'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.603681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 981/1963] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:32 2022] DELETE /identity/v3/users/b2bf11d353eb4c1aa6839de4ada6aa56 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:32.616746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:32.617688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:32.631777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dbe92-736f-4d6e-82e6-ddc9c4e317b6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:32.717705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:32.718645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:32.718934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:32.719212 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] PATH_INFO: `/v3/projects/9150718264e740609afc0c5e24aafe0d` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:32.721620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9150718264e740609afc0c5e24aafe0d)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:32.728451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:32.797237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9150718264e740609afc0c5e24aafe0d', 'request_id': 'req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.804535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9150718264e740609afc0c5e24aafe0d', 'request_id': 'req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.828011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9150718264e740609afc0c5e24aafe0d', 'request_id': 'req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.847380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] The token cache is being invalidate because project 9150718264e740609afc0c5e24aafe0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:32.847788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.853267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:32.853267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 983/1964] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:32 2022] DELETE /identity/v3/projects/9150718264e740609afc0c5e24aafe0d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:32.854915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:32.856407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:32.889776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3efbe-9c1c-4029-a1e3-58901f078880 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:32.974218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:32.975883 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:32.975883 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:32.976079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] PATH_INFO: `/v3/users/7e209280e6f94e5f84ddb90d60801d31` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:32.977617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e209280e6f94e5f84ddb90d60801d31)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:32.981104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:33.064016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e209280e6f94e5f84ddb90d60801d31'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.064805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e209280e6f94e5f84ddb90d60801d31'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.082541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e209280e6f94e5f84ddb90d60801d31'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.091975 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e209280e6f94e5f84ddb90d60801d31'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.092765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e209280e6f94e5f84ddb90d60801d31'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.112433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 982/1965] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:32 2022] DELETE /identity/v3/users/7e209280e6f94e5f84ddb90d60801d31 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:33.428408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:33.428610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:33.429987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:33.430366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:33.442096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:33.469869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d626e05-ad4f-4cc9-b9c6-aad770a02eaf admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:33.555602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa20f-a654-42e6-a653-210bb5b52a9e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:33.561430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:33.561822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:33.562583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:33.562937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:33.563423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] PATH_INFO: `/v3/projects/598b8f4c733b4db4809f0a78202eae5b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:33.563529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:33.563821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:33.564285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] PATH_INFO: `/v3/projects/ff747cb80b7545cdaaa3036b8cecbe9c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:33.565537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=598b8f4c733b4db4809f0a78202eae5b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:33.565810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff747cb80b7545cdaaa3036b8cecbe9c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:33.567846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:33.568560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:33.597879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:33.626748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff747cb80b7545cdaaa3036b8cecbe9c', 'request_id': 'req-662b33ed-fde6-4946-9db1-059fd4b14910'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.629167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598b8f4c733b4db4809f0a78202eae5b', 'request_id': 'req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.635882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598b8f4c733b4db4809f0a78202eae5b', 'request_id': 'req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.637228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff747cb80b7545cdaaa3036b8cecbe9c', 'request_id': 'req-662b33ed-fde6-4946-9db1-059fd4b14910'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.647714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff747cb80b7545cdaaa3036b8cecbe9c', 'request_id': 'req-662b33ed-fde6-4946-9db1-059fd4b14910'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.648680 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598b8f4c733b4db4809f0a78202eae5b', 'request_id': 'req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.661473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] The token cache is being invalidate because project ff747cb80b7545cdaaa3036b8cecbe9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:33.661903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.662563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.663248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] The token cache is being invalidate because project 598b8f4c733b4db4809f0a78202eae5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:33.664166 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.664594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 983/1966] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:33 2022] DELETE /identity/v3/projects/ff747cb80b7545cdaaa3036b8cecbe9c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:33.664728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0a5ca597-c2a6-4f4e-a581-0258b1aa3c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.666535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 984/1967] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:33 2022] DELETE /identity/v3/projects/598b8f4c733b4db4809f0a78202eae5b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:33.668713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:33.669753 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:33.672252 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee8dff-4f33-43d6-ad5f-5d9c1b31667e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:33.672685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee8dff-4f33-43d6-ad5f-5d9c1b31667e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:33.673058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee8dff-4f33-43d6-ad5f-5d9c1b31667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:33.694055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1fee8dff-4f33-43d6-ad5f-5d9c1b31667e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:33.695431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1fee8dff-4f33-43d6-ad5f-5d9c1b31667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:33.752789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b33ed-fde6-4946-9db1-059fd4b14910 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:33.766729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 985/1968] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:33.776326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff2dc-adb3-4def-aa28-7f58675596c3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:33.777136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff2dc-adb3-4def-aa28-7f58675596c3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:33.777136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff2dc-adb3-4def-aa28-7f58675596c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:33.798852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-db7ff2dc-adb3-4def-aa28-7f58675596c3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:33.800418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-db7ff2dc-adb3-4def-aa28-7f58675596c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:33.803472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:33.813497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 986/1969] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:33.817571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff2dc-adb3-4def-aa28-7f58675596c3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:33.828562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff2dc-adb3-4def-aa28-7f58675596c3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:33.830570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:33.831562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:33.831925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:33.832323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] PATH_INFO: `/v3/users/86029c4cb0b7406493869efd7ee4c6bd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:33.833629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] RBAC: Authorizing `identity:delete_user(user_id=86029c4cb0b7406493869efd7ee4c6bd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:33.834924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbdd4d-5088-4001-ae7c-4fdc9a9a2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:33.835622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbdd4d-5088-4001-ae7c-4fdc9a9a2ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:33.835746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:33.836443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbdd4d-5088-4001-ae7c-4fdc9a9a2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:33.836841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbdd4d-5088-4001-ae7c-4fdc9a9a2ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:33.838778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbdd4d-5088-4001-ae7c-4fdc9a9a2ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:33.839098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbdd4d-5088-4001-ae7c-4fdc9a9a2ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:33.841587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbdd4d-5088-4001-ae7c-4fdc9a9a2ec1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:33.858592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 987/1970] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:33.863299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbdd4d-5088-4001-ae7c-4fdc9a9a2ec1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:33.875830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbdd4d-5088-4001-ae7c-4fdc9a9a2ec1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:33.882825 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc79ba8-c66d-41a8-87b3-9eaf0b8aa0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:33.883999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc79ba8-c66d-41a8-87b3-9eaf0b8aa0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:33.884809 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc79ba8-c66d-41a8-87b3-9eaf0b8aa0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:33.885072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc79ba8-c66d-41a8-87b3-9eaf0b8aa0c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:33.885987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc79ba8-c66d-41a8-87b3-9eaf0b8aa0c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:33.887994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc79ba8-c66d-41a8-87b3-9eaf0b8aa0c4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:33.893833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86029c4cb0b7406493869efd7ee4c6bd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.894508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86029c4cb0b7406493869efd7ee4c6bd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.905394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86029c4cb0b7406493869efd7ee4c6bd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.913853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86029c4cb0b7406493869efd7ee4c6bd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.915010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86029c4cb0b7406493869efd7ee4c6bd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:33.921854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 988/1971] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:33 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:33.922887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc79ba8-c66d-41a8-87b3-9eaf0b8aa0c4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:33.930885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7dc79ba8-c66d-41a8-87b3-9eaf0b8aa0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:33.938431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 984/1972] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:33 2022] DELETE /identity/v3/users/86029c4cb0b7406493869efd7ee4c6bd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:34.054243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc79ba8-c66d-41a8-87b3-9eaf0b8aa0c4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:34.129697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:34.247460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae36c16-ca8c-4138-930a-9be115216248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:34.248222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36c16-ca8c-4138-930a-9be115216248 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:34.249535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36c16-ca8c-4138-930a-9be115216248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:34.249880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36c16-ca8c-4138-930a-9be115216248 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:34.251914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae36c16-ca8c-4138-930a-9be115216248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:34.254861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae36c16-ca8c-4138-930a-9be115216248 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:34.302058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 989/1973] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:33 2022] POST /identity/v3/users => generated 284 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:34.304084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:34.316071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a06361-bd97-46d3-849d-8f2a67f9748a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:34.321552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ec44-dead-404c-ad7e-7b4bedd63720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:34.322830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ec44-dead-404c-ad7e-7b4bedd63720 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:34.323529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ec44-dead-404c-ad7e-7b4bedd63720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:34.323988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ec44-dead-404c-ad7e-7b4bedd63720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:34.324976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59ec44-dead-404c-ad7e-7b4bedd63720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:34.328581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59ec44-dead-404c-ad7e-7b4bedd63720 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:34.364849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 985/1974] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:34.365142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae36c16-ca8c-4138-930a-9be115216248 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:34.380389 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae36c16-ca8c-4138-930a-9be115216248 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:34.391022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd4fe2-cc49-4429-a5cd-f5294a0146ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:34.391526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4fe2-cc49-4429-a5cd-f5294a0146ad admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:34.391942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4fe2-cc49-4429-a5cd-f5294a0146ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:34.392692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4fe2-cc49-4429-a5cd-f5294a0146ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:34.393660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd4fe2-cc49-4429-a5cd-f5294a0146ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:34.395517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd4fe2-cc49-4429-a5cd-f5294a0146ad admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:34.431174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 990/1975] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:34.435519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ec44-dead-404c-ad7e-7b4bedd63720 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:34.446447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ec44-dead-404c-ad7e-7b4bedd63720 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:34.460749 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f1c12-dedb-4684-9ffe-aecc5268c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:34.463472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f1c12-dedb-4684-9ffe-aecc5268c0af admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:34.463770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f1c12-dedb-4684-9ffe-aecc5268c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:34.464065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f1c12-dedb-4684-9ffe-aecc5268c0af admin admin] PATH_INFO: `/v3/projects/09c8821eeefd4735ab853f60374ba26c/users/4dce5223624540c1bf00bd03c1c8f7bc/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:34.496933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f1c12-dedb-4684-9ffe-aecc5268c0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c8821eeefd4735ab853f60374ba26c, user_id=4dce5223624540c1bf00bd03c1c8f7bc, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:34.499667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f1c12-dedb-4684-9ffe-aecc5268c0af admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:34.524940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 986/1976] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:34 2022] PUT /identity/v3/projects/09c8821eeefd4735ab853f60374ba26c/users/4dce5223624540c1bf00bd03c1c8f7bc/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:34.539013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130cf4a-f833-4319-a60e-274ef7d296cf None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:34.539495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130cf4a-f833-4319-a60e-274ef7d296cf None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:34.539980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130cf4a-f833-4319-a60e-274ef7d296cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:34.577530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a130cf4a-f833-4319-a60e-274ef7d296cf None None] MFA Rules not processed for user `4dce5223624540c1bf00bd03c1c8f7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:34.578855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a130cf4a-f833-4319-a60e-274ef7d296cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:34.699976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 991/1977] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:34.703553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f1c12-dedb-4684-9ffe-aecc5268c0af admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:34.822573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f1c12-dedb-4684-9ffe-aecc5268c0af admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:34.827990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbee71-96b7-465c-a4e5-2dd9bdf5cf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:34.828809 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbee71-96b7-465c-a4e5-2dd9bdf5cf29 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:34.829096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbee71-96b7-465c-a4e5-2dd9bdf5cf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:34.829369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbee71-96b7-465c-a4e5-2dd9bdf5cf29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:34.830077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbee71-96b7-465c-a4e5-2dd9bdf5cf29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:34.832520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbee71-96b7-465c-a4e5-2dd9bdf5cf29 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:34.873827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 987/1978] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:34 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:34.875306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130cf4a-f833-4319-a60e-274ef7d296cf None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:34.907109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130cf4a-f833-4319-a60e-274ef7d296cf None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:34.988959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579a7d7-e864-4809-8f8a-e8944b192f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:34.990141 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579a7d7-e864-4809-8f8a-e8944b192f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:34.990624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579a7d7-e864-4809-8f8a-e8944b192f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:34.991079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579a7d7-e864-4809-8f8a-e8944b192f14 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:34.991953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579a7d7-e864-4809-8f8a-e8944b192f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:34.994709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579a7d7-e864-4809-8f8a-e8944b192f14 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:35.029635 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 992/1979] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:34 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:35.034631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbee71-96b7-465c-a4e5-2dd9bdf5cf29 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:35.058988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbee71-96b7-465c-a4e5-2dd9bdf5cf29 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:35.068442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5d65f-044d-42b6-a7c7-c4fdfa2f3151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:35.069170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5d65f-044d-42b6-a7c7-c4fdfa2f3151 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.069452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5d65f-044d-42b6-a7c7-c4fdfa2f3151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.069729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5d65f-044d-42b6-a7c7-c4fdfa2f3151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.075003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5d65f-044d-42b6-a7c7-c4fdfa2f3151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:35.077140 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5d65f-044d-42b6-a7c7-c4fdfa2f3151 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:35.084083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:35.110949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 988/1980] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:35.115334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579a7d7-e864-4809-8f8a-e8944b192f14 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:35.131404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579a7d7-e864-4809-8f8a-e8944b192f14 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:35.142672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba04a9-f0d8-427c-8183-20dc3bd0aa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:35.143606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba04a9-f0d8-427c-8183-20dc3bd0aa24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.143986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba04a9-f0d8-427c-8183-20dc3bd0aa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.144263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba04a9-f0d8-427c-8183-20dc3bd0aa24 admin admin] PATH_INFO: `/v3/projects/1371b81baa9e48119c4b4ceb919b6098/users/fba44233af3c4a3ca8881ab4d82c70a2/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.160855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:35.168608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba04a9-f0d8-427c-8183-20dc3bd0aa24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1371b81baa9e48119c4b4ceb919b6098, user_id=fba44233af3c4a3ca8881ab4d82c70a2, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:35.173489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba04a9-f0d8-427c-8183-20dc3bd0aa24 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:35.196842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 993/1981] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:35 2022] PUT /identity/v3/projects/1371b81baa9e48119c4b4ceb919b6098/users/fba44233af3c4a3ca8881ab4d82c70a2/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:35.209083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5d65f-044d-42b6-a7c7-c4fdfa2f3151 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:35.224466 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5d65f-044d-42b6-a7c7-c4fdfa2f3151 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:35.320304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c43378-e828-4f0f-afc9-e8da57359d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:35.322056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c43378-e828-4f0f-afc9-e8da57359d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.322517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c43378-e828-4f0f-afc9-e8da57359d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.323857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c43378-e828-4f0f-afc9-e8da57359d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.329252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c43378-e828-4f0f-afc9-e8da57359d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:35.331648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c43378-e828-4f0f-afc9-e8da57359d73 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:35.349873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 989/1982] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:35.351747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba04a9-f0d8-427c-8183-20dc3bd0aa24 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:35.370688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba04a9-f0d8-427c-8183-20dc3bd0aa24 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:35.389552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf3b35-002f-422b-907b-743094576321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:35.390724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf3b35-002f-422b-907b-743094576321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.391221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf3b35-002f-422b-907b-743094576321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.391686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf3b35-002f-422b-907b-743094576321 admin admin] PATH_INFO: `/v3/projects/1371b81baa9e48119c4b4ceb919b6098/users/fba44233af3c4a3ca8881ab4d82c70a2/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.395365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf3b35-002f-422b-907b-743094576321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1371b81baa9e48119c4b4ceb919b6098, user_id=fba44233af3c4a3ca8881ab4d82c70a2, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:35.398621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf3b35-002f-422b-907b-743094576321 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:35.417495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 994/1983] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:35 2022] PUT /identity/v3/projects/1371b81baa9e48119c4b4ceb919b6098/users/fba44233af3c4a3ca8881ab4d82c70a2/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:35.420461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c43378-e828-4f0f-afc9-e8da57359d73 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:35.423100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-71c43378-e828-4f0f-afc9-e8da57359d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:35.424951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869118e1-107e-4d7e-b7f9-163ba2bae42b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.428489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869118e1-107e-4d7e-b7f9-163ba2bae42b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.428489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869118e1-107e-4d7e-b7f9-163ba2bae42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.452378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c43378-e828-4f0f-afc9-e8da57359d73 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:35.519568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-869118e1-107e-4d7e-b7f9-163ba2bae42b None None] MFA Rules not processed for user `fba44233af3c4a3ca8881ab4d82c70a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:35.522568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-869118e1-107e-4d7e-b7f9-163ba2bae42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:35.545853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:35.546960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.547149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.547569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] PATH_INFO: `/v3/projects/95dc411fd0914e4d928a28aac4fa78a1` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.548971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95dc411fd0914e4d928a28aac4fa78a1)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:35.551346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:35.622247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95dc411fd0914e4d928a28aac4fa78a1', 'request_id': 'req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:35.634501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95dc411fd0914e4d928a28aac4fa78a1', 'request_id': 'req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:35.646399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95dc411fd0914e4d928a28aac4fa78a1', 'request_id': 'req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:35.668545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] The token cache is being invalidate because project 95dc411fd0914e4d928a28aac4fa78a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:35.669382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:35.670738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:35.673016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 995/1984] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:35.673896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 990/1985] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:35 2022] DELETE /identity/v3/projects/95dc411fd0914e4d928a28aac4fa78a1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:35.678547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28971b1-b47f-4a71-8e61-9755ea9787a0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.678845 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28971b1-b47f-4a71-8e61-9755ea9787a0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.679169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28971b1-b47f-4a71-8e61-9755ea9787a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.686712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:35.688884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:35.714997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c28971b1-b47f-4a71-8e61-9755ea9787a0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:35.718481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:35.721348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c28971b1-b47f-4a71-8e61-9755ea9787a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:35.780430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9e4ae-0e4c-4173-b714-55cf0eadb0c8 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:35.785352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fed9c-7a96-4870-9bd0-790a19f12af8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:35.786526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fed9c-7a96-4870-9bd0-790a19f12af8 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.787227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fed9c-7a96-4870-9bd0-790a19f12af8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.787690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fed9c-7a96-4870-9bd0-790a19f12af8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.790862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e35fed9c-7a96-4870-9bd0-790a19f12af8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:35.836855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 996/1986] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:35.840038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdd659-6181-4816-a723-d5b61b46a4f8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.840325 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdd659-6181-4816-a723-d5b61b46a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.840600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdd659-6181-4816-a723-d5b61b46a4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.878059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1ecdd659-6181-4816-a723-d5b61b46a4f8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:35.880641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1ecdd659-6181-4816-a723-d5b61b46a4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:35.896629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 997/1987] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:35.897798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdd659-6181-4816-a723-d5b61b46a4f8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:35.898016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fed9c-7a96-4870-9bd0-790a19f12af8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:35.899970 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fed9c-7a96-4870-9bd0-790a19f12af8 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:35.914381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 991/1988] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:35.919070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdd659-6181-4816-a723-d5b61b46a4f8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:35.925728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9a943-c433-46b4-8d3a-61f6185807de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:35.926408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9a943-c433-46b4-8d3a-61f6185807de admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.928477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9a943-c433-46b4-8d3a-61f6185807de admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.928477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9a943-c433-46b4-8d3a-61f6185807de admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.928477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9a943-c433-46b4-8d3a-61f6185807de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:35.928861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9a943-c433-46b4-8d3a-61f6185807de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:35.930557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9a943-c433-46b4-8d3a-61f6185807de admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:35.946460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 998/1989] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:35.950854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fed9c-7a96-4870-9bd0-790a19f12af8 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:35.965615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fed9c-7a96-4870-9bd0-790a19f12af8 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:35.971656 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4d95b-8424-4212-b1e5-0c359b710246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:35.972336 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4d95b-8424-4212-b1e5-0c359b710246 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:35.972619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4d95b-8424-4212-b1e5-0c359b710246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:35.973481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4d95b-8424-4212-b1e5-0c359b710246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:35.974123 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4d95b-8424-4212-b1e5-0c359b710246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:35.977287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4d95b-8424-4212-b1e5-0c359b710246 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:36.012494 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 992/1990] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:35 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:36.016413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9a943-c433-46b4-8d3a-61f6185807de admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:36.028741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9a943-c433-46b4-8d3a-61f6185807de admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:36.030476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4d95b-8424-4212-b1e5-0c359b710246 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:36.080524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:36.099606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4d95b-8424-4212-b1e5-0c359b710246 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:36.103826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4314cfa-5332-4e18-8a74-2c868a719651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:36.104495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4314cfa-5332-4e18-8a74-2c868a719651 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:36.105957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4314cfa-5332-4e18-8a74-2c868a719651 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:36.105957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4314cfa-5332-4e18-8a74-2c868a719651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:36.107334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e4314cfa-5332-4e18-8a74-2c868a719651 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:36.112694 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cd4f0-d9a0-47da-8fd9-165de086be87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:36.113412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cd4f0-d9a0-47da-8fd9-165de086be87 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:36.113701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cd4f0-d9a0-47da-8fd9-165de086be87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:36.113978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cd4f0-d9a0-47da-8fd9-165de086be87 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:36.114695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cd4f0-d9a0-47da-8fd9-165de086be87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:36.116795 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cd4f0-d9a0-47da-8fd9-165de086be87 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:36.151366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 999/1991] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:36 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:36.155336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cd4f0-d9a0-47da-8fd9-165de086be87 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:36.166758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cd4f0-d9a0-47da-8fd9-165de086be87 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:36.171420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd76e8b-69fd-4abf-a76c-4ee4c5278f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:36.172247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd76e8b-69fd-4abf-a76c-4ee4c5278f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:36.172535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd76e8b-69fd-4abf-a76c-4ee4c5278f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:36.172858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd76e8b-69fd-4abf-a76c-4ee4c5278f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:36.173595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd76e8b-69fd-4abf-a76c-4ee4c5278f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:36.175239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd76e8b-69fd-4abf-a76c-4ee4c5278f3c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:36.178595 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4314cfa-5332-4e18-8a74-2c868a719651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:36.180163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4314cfa-5332-4e18-8a74-2c868a719651 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:36.187370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1000/1992] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:36.190601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 993/1993] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:36.191247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd76e8b-69fd-4abf-a76c-4ee4c5278f3c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:36.202878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd76e8b-69fd-4abf-a76c-4ee4c5278f3c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:36.208155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212894b-5c85-4e5a-848e-543b330cc649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:36.208585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212894b-5c85-4e5a-848e-543b330cc649 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:36.208894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212894b-5c85-4e5a-848e-543b330cc649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:36.209164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212894b-5c85-4e5a-848e-543b330cc649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:36.209899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212894b-5c85-4e5a-848e-543b330cc649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:36.211481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212894b-5c85-4e5a-848e-543b330cc649 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:36.223832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1001/1994] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:36.228099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4314cfa-5332-4e18-8a74-2c868a719651 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:36.240541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4314cfa-5332-4e18-8a74-2c868a719651 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:36.247029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438267bf-693e-4687-a0df-78fdfee1925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:36.247485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438267bf-693e-4687-a0df-78fdfee1925e admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:36.247766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438267bf-693e-4687-a0df-78fdfee1925e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:36.248158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438267bf-693e-4687-a0df-78fdfee1925e admin admin] PATH_INFO: `/v3/projects/b7036bd5625e44169bdaa182ebf9e3b3/users/63d1f034ccd543ff824c097bfa9725e9/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:36.250633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:36.275833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438267bf-693e-4687-a0df-78fdfee1925e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7036bd5625e44169bdaa182ebf9e3b3, user_id=63d1f034ccd543ff824c097bfa9725e9, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:36.279698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438267bf-693e-4687-a0df-78fdfee1925e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:36.297282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 994/1995] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:36 2022] PUT /identity/v3/projects/b7036bd5625e44169bdaa182ebf9e3b3/users/63d1f034ccd543ff824c097bfa9725e9/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:36.307928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91327c-f109-4542-98cf-afc47b1097a2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:36.308219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91327c-f109-4542-98cf-afc47b1097a2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:36.308477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91327c-f109-4542-98cf-afc47b1097a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:36.341033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-fb91327c-f109-4542-98cf-afc47b1097a2 None None] MFA Rules not processed for user `63d1f034ccd543ff824c097bfa9725e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:36.342290 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fb91327c-f109-4542-98cf-afc47b1097a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:36.433491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1002/1996] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:36.445688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438267bf-693e-4687-a0df-78fdfee1925e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:36.447934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-438267bf-693e-4687-a0df-78fdfee1925e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:36.533604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438267bf-693e-4687-a0df-78fdfee1925e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:36.539408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc800e-1580-4739-844d-8d094f50868d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf4ab9d717e4c838d68590336074f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:36.540968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc800e-1580-4739-844d-8d094f50868d service glance] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:36.541530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc800e-1580-4739-844d-8d094f50868d service glance] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:36.541934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc800e-1580-4739-844d-8d094f50868d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:36.556197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc800e-1580-4739-844d-8d094f50868d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:36.558009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc800e-1580-4739-844d-8d094f50868d service glance] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:36.579181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 995/1997] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:41.317529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91327c-f109-4542-98cf-afc47b1097a2 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:41.319132 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fb91327c-f109-4542-98cf-afc47b1097a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:41.392296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91327c-f109-4542-98cf-afc47b1097a2 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:41.397158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:41.398057 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:41.398322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:41.398594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] PATH_INFO: `/v3/users/4dce5223624540c1bf00bd03c1c8f7bc` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:41.399985 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dce5223624540c1bf00bd03c1c8f7bc)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:41.401956 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:41.450346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:41.457068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dce5223624540c1bf00bd03c1c8f7bc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:41.466599 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dce5223624540c1bf00bd03c1c8f7bc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:41.467480 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dce5223624540c1bf00bd03c1c8f7bc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:41.475456 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dce5223624540c1bf00bd03c1c8f7bc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:41.476225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dce5223624540c1bf00bd03c1c8f7bc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:41.494706 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1003/1998] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:41 2022] DELETE /identity/v3/users/4dce5223624540c1bf00bd03c1c8f7bc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:41.499434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959e16-bf95-4538-9c55-80335ebf3b1d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:41.499957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959e16-bf95-4538-9c55-80335ebf3b1d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:41.500178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959e16-bf95-4538-9c55-80335ebf3b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:41.520022 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-99959e16-bf95-4538-9c55-80335ebf3b1d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:41.521279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-99959e16-bf95-4538-9c55-80335ebf3b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:41.595066 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 996/1999] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:41.605466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:41.606957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:41.668220 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f86a-1781-4989-b354-94a7d20b69fa admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:41.672607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93840d5f-8975-4e69-a529-0200ed9fed72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:41.673394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93840d5f-8975-4e69-a529-0200ed9fed72 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:41.673685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93840d5f-8975-4e69-a529-0200ed9fed72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:41.674134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93840d5f-8975-4e69-a529-0200ed9fed72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:41.689986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93840d5f-8975-4e69-a529-0200ed9fed72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:41.691480 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93840d5f-8975-4e69-a529-0200ed9fed72 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:41.702983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1004/2000] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:42.070102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99959e16-bf95-4538-9c55-80335ebf3b1d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:42.071962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-99959e16-bf95-4538-9c55-80335ebf3b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:42.085204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99959e16-bf95-4538-9c55-80335ebf3b1d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:42.090405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:42.092231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:42.092231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:42.092562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] PATH_INFO: `/v3/projects/09c8821eeefd4735ab853f60374ba26c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:42.099784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c8821eeefd4735ab853f60374ba26c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:42.101990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:42.162569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c8821eeefd4735ab853f60374ba26c', 'request_id': 'req-88734921-a416-4ec8-a3fb-4864782f3ae7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.173518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c8821eeefd4735ab853f60374ba26c', 'request_id': 'req-88734921-a416-4ec8-a3fb-4864782f3ae7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.180857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c8821eeefd4735ab853f60374ba26c', 'request_id': 'req-88734921-a416-4ec8-a3fb-4864782f3ae7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.193368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] The token cache is being invalidate because project 09c8821eeefd4735ab853f60374ba26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:42.193653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.194306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.195878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 997/2001] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:42 2022] DELETE /identity/v3/projects/09c8821eeefd4735ab853f60374ba26c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:42.200592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93840d5f-8975-4e69-a529-0200ed9fed72 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:42.214185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93840d5f-8975-4e69-a529-0200ed9fed72 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:42.275296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:42.276464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:42.276933 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:42.277220 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] PATH_INFO: `/v3/users/fba44233af3c4a3ca8881ab4d82c70a2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:42.279166 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba44233af3c4a3ca8881ab4d82c70a2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:42.281197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:42.333243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba44233af3c4a3ca8881ab4d82c70a2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.344222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba44233af3c4a3ca8881ab4d82c70a2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.344902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba44233af3c4a3ca8881ab4d82c70a2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.353072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba44233af3c4a3ca8881ab4d82c70a2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.354000 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a703c1c1-98da-41e8-b141-6d5b8d1611d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba44233af3c4a3ca8881ab4d82c70a2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.355392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:42.392492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1005/2002] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:42 2022] DELETE /identity/v3/users/fba44233af3c4a3ca8881ab4d82c70a2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:42.696786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:42.698559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:42.721790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88734921-a416-4ec8-a3fb-4864782f3ae7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:42.735381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:42.798573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:42.799515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:42.799794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:42.800064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] PATH_INFO: `/v3/projects/1371b81baa9e48119c4b4ceb919b6098` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:42.801308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1371b81baa9e48119c4b4ceb919b6098)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:42.803291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:42.879575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1371b81baa9e48119c4b4ceb919b6098', 'request_id': 'req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.895210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1371b81baa9e48119c4b4ceb919b6098', 'request_id': 'req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.906090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1371b81baa9e48119c4b4ceb919b6098', 'request_id': 'req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.918508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] The token cache is being invalidate because project 1371b81baa9e48119c4b4ceb919b6098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:42.918800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.919510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2c26c02-c091-4e55-bff4-d0ffc8e963a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:42.924705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 998/2003] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:42 2022] DELETE /identity/v3/projects/1371b81baa9e48119c4b4ceb919b6098 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:42.926747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7777d-cd4c-43fe-9c82-a74857dd6103 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:42.927383 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7777d-cd4c-43fe-9c82-a74857dd6103 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:42.928715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7777d-cd4c-43fe-9c82-a74857dd6103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:42.953333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8ae7777d-cd4c-43fe-9c82-a74857dd6103 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:42.954721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8ae7777d-cd4c-43fe-9c82-a74857dd6103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:43.038087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1006/2004] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:43.049471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb36f8-38ee-4b04-a3bf-7bbd374384ba None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.049802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb36f8-38ee-4b04-a3bf-7bbd374384ba None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.050214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb36f8-38ee-4b04-a3bf-7bbd374384ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:43.071829 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-93bb36f8-38ee-4b04-a3bf-7bbd374384ba None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:43.073139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-93bb36f8-38ee-4b04-a3bf-7bbd374384ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:43.081710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 999/2005] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:43.085919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7777d-cd4c-43fe-9c82-a74857dd6103 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:43.097620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7777d-cd4c-43fe-9c82-a74857dd6103 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:43.106355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a04e7-11d8-4dd2-8215-b3a9b78c31e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:43.115557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a04e7-11d8-4dd2-8215-b3a9b78c31e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.115906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a04e7-11d8-4dd2-8215-b3a9b78c31e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.116206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a04e7-11d8-4dd2-8215-b3a9b78c31e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:43.117189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a04e7-11d8-4dd2-8215-b3a9b78c31e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:43.117567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a04e7-11d8-4dd2-8215-b3a9b78c31e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:43.124217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a04e7-11d8-4dd2-8215-b3a9b78c31e3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:43.144756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1007/2006] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:43.146423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb36f8-38ee-4b04-a3bf-7bbd374384ba None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:43.157085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb36f8-38ee-4b04-a3bf-7bbd374384ba None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:43.168244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729c134-8b68-4d7c-a28d-abd9cb2470d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:43.169393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729c134-8b68-4d7c-a28d-abd9cb2470d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.169393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729c134-8b68-4d7c-a28d-abd9cb2470d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.169711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729c134-8b68-4d7c-a28d-abd9cb2470d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:43.170587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729c134-8b68-4d7c-a28d-abd9cb2470d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:43.172798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729c134-8b68-4d7c-a28d-abd9cb2470d2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:43.212327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1000/2007] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:43 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:43.216386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a04e7-11d8-4dd2-8215-b3a9b78c31e3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:43.227165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a04e7-11d8-4dd2-8215-b3a9b78c31e3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:43.296871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342cd75-0b30-45d7-b83c-5b61e2765d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:43.297545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342cd75-0b30-45d7-b83c-5b61e2765d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.297832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342cd75-0b30-45d7-b83c-5b61e2765d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.298115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342cd75-0b30-45d7-b83c-5b61e2765d7f admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:43.298828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342cd75-0b30-45d7-b83c-5b61e2765d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:43.300829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342cd75-0b30-45d7-b83c-5b61e2765d7f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:43.332571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1008/2008] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:43 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:43.334025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729c134-8b68-4d7c-a28d-abd9cb2470d2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:43.345638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729c134-8b68-4d7c-a28d-abd9cb2470d2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:43.350637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf55d0a-d6ac-4aef-9786-9c84781e9931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:43.351359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf55d0a-d6ac-4aef-9786-9c84781e9931 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.351644 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf55d0a-d6ac-4aef-9786-9c84781e9931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.351917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf55d0a-d6ac-4aef-9786-9c84781e9931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:43.352856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf55d0a-d6ac-4aef-9786-9c84781e9931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:43.354888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf55d0a-d6ac-4aef-9786-9c84781e9931 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:43.369120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1001/2009] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:43.373379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342cd75-0b30-45d7-b83c-5b61e2765d7f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:43.384476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342cd75-0b30-45d7-b83c-5b61e2765d7f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:43.391545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3586f40-b2bd-4c97-833d-19cf67567add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:43.392245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3586f40-b2bd-4c97-833d-19cf67567add admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.392535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3586f40-b2bd-4c97-833d-19cf67567add admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.392859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3586f40-b2bd-4c97-833d-19cf67567add admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:43.394015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3586f40-b2bd-4c97-833d-19cf67567add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:43.396120 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3586f40-b2bd-4c97-833d-19cf67567add admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:43.407862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1009/2010] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:43.412869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf55d0a-d6ac-4aef-9786-9c84781e9931 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:43.425989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf55d0a-d6ac-4aef-9786-9c84781e9931 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:43.431185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f07c9-16a1-4ec4-922e-18db26299fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:43.432169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f07c9-16a1-4ec4-922e-18db26299fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.432558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f07c9-16a1-4ec4-922e-18db26299fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.432988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f07c9-16a1-4ec4-922e-18db26299fb1 admin admin] PATH_INFO: `/v3/projects/c088a40e8f424ba083e458b5306b7b43/users/fa7de11cafbf41ec88a6bd27fa3977cb/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:43.459446 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f07c9-16a1-4ec4-922e-18db26299fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c088a40e8f424ba083e458b5306b7b43, user_id=fa7de11cafbf41ec88a6bd27fa3977cb, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:43.462200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f07c9-16a1-4ec4-922e-18db26299fb1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:43.479900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1002/2011] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:43 2022] PUT /identity/v3/projects/c088a40e8f424ba083e458b5306b7b43/users/fa7de11cafbf41ec88a6bd27fa3977cb/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:43.490468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4e96-01aa-4e99-848f-6352cc7ad3de None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.490780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4e96-01aa-4e99-848f-6352cc7ad3de None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.491063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4e96-01aa-4e99-848f-6352cc7ad3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:43.519413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-574f4e96-01aa-4e99-848f-6352cc7ad3de None None] MFA Rules not processed for user `fa7de11cafbf41ec88a6bd27fa3977cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:43.520548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-574f4e96-01aa-4e99-848f-6352cc7ad3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:43.568573 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:43.612826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1010/2012] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:43.624442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f07c9-16a1-4ec4-922e-18db26299fb1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:43.626244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5c0f07c9-16a1-4ec4-922e-18db26299fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:43.683761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:43.713507 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f07c9-16a1-4ec4-922e-18db26299fb1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:43.719787 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7048ef0-c553-425a-9901-8b72b0d8f8e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:43.720767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7048ef0-c553-425a-9901-8b72b0d8f8e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.721228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7048ef0-c553-425a-9901-8b72b0d8f8e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.721565 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7048ef0-c553-425a-9901-8b72b0d8f8e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:43.736401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7048ef0-c553-425a-9901-8b72b0d8f8e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:43.738215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7048ef0-c553-425a-9901-8b72b0d8f8e0 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:43.749456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1003/2013] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:43.774641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f4e96-01aa-4e99-848f-6352cc7ad3de None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:43.860076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f4e96-01aa-4e99-848f-6352cc7ad3de None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:43.864883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:43.865961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.866395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.866773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] PATH_INFO: `/v3/users/fa7de11cafbf41ec88a6bd27fa3977cb` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:43.868322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7de11cafbf41ec88a6bd27fa3977cb)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:43.872932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:43.941328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7de11cafbf41ec88a6bd27fa3977cb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:43.954593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7de11cafbf41ec88a6bd27fa3977cb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:43.955441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7de11cafbf41ec88a6bd27fa3977cb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:43.963954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7de11cafbf41ec88a6bd27fa3977cb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:43.964951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7de11cafbf41ec88a6bd27fa3977cb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:43.994436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1011/2014] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:43 2022] DELETE /identity/v3/users/fa7de11cafbf41ec88a6bd27fa3977cb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:43.999219 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13051788-ee24-469e-8b7c-1ad50d831ee2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:43.999516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13051788-ee24-469e-8b7c-1ad50d831ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:43.999800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13051788-ee24-469e-8b7c-1ad50d831ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:44.022389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-13051788-ee24-469e-8b7c-1ad50d831ee2 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:44.023705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-13051788-ee24-469e-8b7c-1ad50d831ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:44.110881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1004/2015] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:44.120519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:44.122033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:44.188698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81907-6883-458d-817e-a1cf3a63693b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:44.192680 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed296ea5-72a6-4004-a8bd-c76fa953b2af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:44.193457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296ea5-72a6-4004-a8bd-c76fa953b2af service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:44.193835 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296ea5-72a6-4004-a8bd-c76fa953b2af service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:44.194170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296ea5-72a6-4004-a8bd-c76fa953b2af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:44.204348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed296ea5-72a6-4004-a8bd-c76fa953b2af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:44.206072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed296ea5-72a6-4004-a8bd-c76fa953b2af service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:44.210349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:44.219332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1012/2016] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:44.625476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13051788-ee24-469e-8b7c-1ad50d831ee2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:44.627954 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-13051788-ee24-469e-8b7c-1ad50d831ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:44.640317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13051788-ee24-469e-8b7c-1ad50d831ee2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:44.646564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:44.647420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:44.647712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:44.647991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] PATH_INFO: `/v3/projects/c088a40e8f424ba083e458b5306b7b43` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:44.649240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c088a40e8f424ba083e458b5306b7b43)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:44.651408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:44.703060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c088a40e8f424ba083e458b5306b7b43', 'request_id': 'req-519cf018-3eec-408a-917b-e15769ff315f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:44.710281 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c088a40e8f424ba083e458b5306b7b43', 'request_id': 'req-519cf018-3eec-408a-917b-e15769ff315f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:44.717422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c088a40e8f424ba083e458b5306b7b43', 'request_id': 'req-519cf018-3eec-408a-917b-e15769ff315f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:44.731639 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] The token cache is being invalidate because project c088a40e8f424ba083e458b5306b7b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:44.731930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:44.732647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-519cf018-3eec-408a-917b-e15769ff315f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:44.734579 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1005/2017] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:44 2022] DELETE /identity/v3/projects/c088a40e8f424ba083e458b5306b7b43 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:44.739267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f038-5ade-4c97-ad0e-93087a43d9a8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:44.739821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f038-5ade-4c97-ad0e-93087a43d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:44.739821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f038-5ade-4c97-ad0e-93087a43d9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:44.761970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2aa2f038-5ade-4c97-ad0e-93087a43d9a8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:44.763180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2aa2f038-5ade-4c97-ad0e-93087a43d9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:44.829766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1013/2018] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:44.837564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93c25f-91f2-4fcb-8fed-ce1f7d95a1d6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:44.837915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93c25f-91f2-4fcb-8fed-ce1f7d95a1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:44.838386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93c25f-91f2-4fcb-8fed-ce1f7d95a1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:44.857457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5d93c25f-91f2-4fcb-8fed-ce1f7d95a1d6 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:44.858684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5d93c25f-91f2-4fcb-8fed-ce1f7d95a1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:44.876586 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1006/2019] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:44.881136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2f038-5ade-4c97-ad0e-93087a43d9a8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:44.891709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2f038-5ade-4c97-ad0e-93087a43d9a8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:44.897064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84b242-6673-467d-8b65-3ded0310d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:44.897888 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84b242-6673-467d-8b65-3ded0310d4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:44.898268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84b242-6673-467d-8b65-3ded0310d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:44.898639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84b242-6673-467d-8b65-3ded0310d4e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:44.899483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84b242-6673-467d-8b65-3ded0310d4e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:44.899855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84b242-6673-467d-8b65-3ded0310d4e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:44.901887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84b242-6673-467d-8b65-3ded0310d4e8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:44.928887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1014/2020] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:44.933668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93c25f-91f2-4fcb-8fed-ce1f7d95a1d6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:44.951828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93c25f-91f2-4fcb-8fed-ce1f7d95a1d6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:44.957624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6116f05-cbe2-4143-bbc7-325baf60f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:44.962503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6116f05-cbe2-4143-bbc7-325baf60f83a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:44.962931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6116f05-cbe2-4143-bbc7-325baf60f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:44.963282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6116f05-cbe2-4143-bbc7-325baf60f83a admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:44.964079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6116f05-cbe2-4143-bbc7-325baf60f83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:44.966226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6116f05-cbe2-4143-bbc7-325baf60f83a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:45.014219 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1007/2021] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:44 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:45.018979 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84b242-6673-467d-8b65-3ded0310d4e8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:45.034856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84b242-6673-467d-8b65-3ded0310d4e8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:45.158080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227bfd8-bf60-48fc-b0d7-d33802c85f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:45.158960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227bfd8-bf60-48fc-b0d7-d33802c85f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:45.159267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227bfd8-bf60-48fc-b0d7-d33802c85f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:45.159679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227bfd8-bf60-48fc-b0d7-d33802c85f06 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:45.160655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227bfd8-bf60-48fc-b0d7-d33802c85f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:45.167645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227bfd8-bf60-48fc-b0d7-d33802c85f06 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:45.198134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1015/2022] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:45 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:45.198910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6116f05-cbe2-4143-bbc7-325baf60f83a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:45.210602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6116f05-cbe2-4143-bbc7-325baf60f83a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:45.216015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7179c-9d0f-4ba4-bd95-6ad05449b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:45.216966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7179c-9d0f-4ba4-bd95-6ad05449b1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:45.217104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7179c-9d0f-4ba4-bd95-6ad05449b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:45.217373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7179c-9d0f-4ba4-bd95-6ad05449b1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:45.218662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7179c-9d0f-4ba4-bd95-6ad05449b1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:45.220327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7179c-9d0f-4ba4-bd95-6ad05449b1e6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:45.243503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1008/2023] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:45.248106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227bfd8-bf60-48fc-b0d7-d33802c85f06 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:45.260647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227bfd8-bf60-48fc-b0d7-d33802c85f06 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:45.272964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69338c-6f3e-4cf8-93d0-65bda697d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:45.273790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69338c-6f3e-4cf8-93d0-65bda697d1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:45.274083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69338c-6f3e-4cf8-93d0-65bda697d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:45.274362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69338c-6f3e-4cf8-93d0-65bda697d1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:45.275165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69338c-6f3e-4cf8-93d0-65bda697d1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:45.279542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69338c-6f3e-4cf8-93d0-65bda697d1ea admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:45.292629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1016/2024] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:45.296863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7179c-9d0f-4ba4-bd95-6ad05449b1e6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:45.313246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7179c-9d0f-4ba4-bd95-6ad05449b1e6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:45.318910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904eba3-c738-4531-83ad-234146f92ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:45.325231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904eba3-c738-4531-83ad-234146f92ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:45.325231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904eba3-c738-4531-83ad-234146f92ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:45.325231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904eba3-c738-4531-83ad-234146f92ec4 admin admin] PATH_INFO: `/v3/projects/ce64d2b69c794fdeac1d1ad3aee85af1/users/a307f69420c64989975bf1075ac78c65/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:45.340045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904eba3-c738-4531-83ad-234146f92ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce64d2b69c794fdeac1d1ad3aee85af1, user_id=a307f69420c64989975bf1075ac78c65, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:45.343597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904eba3-c738-4531-83ad-234146f92ec4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:45.352350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:45.360308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1009/2025] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:45 2022] PUT /identity/v3/projects/ce64d2b69c794fdeac1d1ad3aee85af1/users/a307f69420c64989975bf1075ac78c65/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:45.372483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022716c-5910-455c-aadd-fa9c136ebb87 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:45.372964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022716c-5910-455c-aadd-fa9c136ebb87 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:45.373351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022716c-5910-455c-aadd-fa9c136ebb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:45.410209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b022716c-5910-455c-aadd-fa9c136ebb87 None None] MFA Rules not processed for user `a307f69420c64989975bf1075ac78c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:45.411561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b022716c-5910-455c-aadd-fa9c136ebb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:45.479429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:45.492026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1017/2026] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:45.504241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904eba3-c738-4531-83ad-234146f92ec4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:45.508737 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5904eba3-c738-4531-83ad-234146f92ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:45.575360 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b16b81-6e13-4f21-841b-ad9aa136a09f None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:45.575717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b16b81-6e13-4f21-841b-ad9aa136a09f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:45.575953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b16b81-6e13-4f21-841b-ad9aa136a09f None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:45.576174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904eba3-c738-4531-83ad-234146f92ec4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:45.577799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1018/2027] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:19:45.580096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f3722-a9e6-48b2-84f1-b1cb13896d12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf4ab9d717e4c838d68590336074f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:45.580830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f3722-a9e6-48b2-84f1-b1cb13896d12 service glance] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:45.581114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f3722-a9e6-48b2-84f1-b1cb13896d12 service glance] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:45.581393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f3722-a9e6-48b2-84f1-b1cb13896d12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:45.594317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76eb6b-8ec5-423f-920d-b78675c684cf None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:45.594759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76eb6b-8ec5-423f-920d-b78675c684cf None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:45.595154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76eb6b-8ec5-423f-920d-b78675c684cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:45.600548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f3722-a9e6-48b2-84f1-b1cb13896d12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:45.602257 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f3722-a9e6-48b2-84f1-b1cb13896d12 service glance] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:45.614553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6c76eb6b-8ec5-423f-920d-b78675c684cf None None] MFA Rules not processed for user `58986e97f4d849aba35149d3666db015`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:45.616122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1010/2028] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:45.618207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6c76eb6b-8ec5-423f-920d-b78675c684cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:45.667852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f3722-a9e6-48b2-84f1-b1cb13896d12 service glance] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:45.670735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ab6f3722-a9e6-48b2-84f1-b1cb13896d12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:45.757761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1019/2029] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:19:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:45.771111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76eb6b-8ec5-423f-920d-b78675c684cf None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:45.772739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6c76eb6b-8ec5-423f-920d-b78675c684cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:45.791288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76eb6b-8ec5-423f-920d-b78675c684cf None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:45.802686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3f3ad-a278-4afe-bd05-ab9fe01251e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:45.803351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3f3ad-a278-4afe-bd05-ab9fe01251e9 service placement] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:45.803631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3f3ad-a278-4afe-bd05-ab9fe01251e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:45.803904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3f3ad-a278-4afe-bd05-ab9fe01251e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:45.822740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3f3ad-a278-4afe-bd05-ab9fe01251e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:45.824372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3f3ad-a278-4afe-bd05-ab9fe01251e9 service placement] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:45.832498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f3722-a9e6-48b2-84f1-b1cb13896d12 service glance] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:45.835240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1020/2030] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:45.841261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:45.842818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:45.843375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:45.843666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] PATH_INFO: `/v3/users/79ac3d72bfd44bb6a79fd37466aa8092` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:45.845047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ac3d72bfd44bb6a79fd37466aa8092)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:45.846982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:45.908157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ac3d72bfd44bb6a79fd37466aa8092'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:45.908865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ac3d72bfd44bb6a79fd37466aa8092'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:45.917288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ac3d72bfd44bb6a79fd37466aa8092'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:45.924476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ac3d72bfd44bb6a79fd37466aa8092'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:45.925222 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-efe324ac-eb1e-41e1-bfb6-99b19ff198e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ac3d72bfd44bb6a79fd37466aa8092'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:45.944819 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1011/2031] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:45 2022] DELETE /identity/v3/users/79ac3d72bfd44bb6a79fd37466aa8092 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:46.150485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3f3ad-a278-4afe-bd05-ab9fe01251e9 service placement] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:46.162849 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3f3ad-a278-4afe-bd05-ab9fe01251e9 service placement] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:46.231941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:46.232856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.233129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.233396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] PATH_INFO: `/v3/projects/1858d275ca114dd0949fa9e454c1f958` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.234564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1858d275ca114dd0949fa9e454c1f958)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:46.236468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:46.288192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1858d275ca114dd0949fa9e454c1f958', 'request_id': 'req-d318c69c-3364-4d60-acf7-4356c9a1225d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:46.295127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1858d275ca114dd0949fa9e454c1f958', 'request_id': 'req-d318c69c-3364-4d60-acf7-4356c9a1225d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:46.304194 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1858d275ca114dd0949fa9e454c1f958', 'request_id': 'req-d318c69c-3364-4d60-acf7-4356c9a1225d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:46.315981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] The token cache is being invalidate because project 1858d275ca114dd0949fa9e454c1f958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:46.316267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:46.316930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d318c69c-3364-4d60-acf7-4356c9a1225d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:46.318454 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1021/2032] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:46 2022] DELETE /identity/v3/projects/1858d275ca114dd0949fa9e454c1f958 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:46.323836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99735-6adc-4a19-8b9e-0174d88ea561 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.324178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99735-6adc-4a19-8b9e-0174d88ea561 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.324458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99735-6adc-4a19-8b9e-0174d88ea561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.347044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d5f99735-6adc-4a19-8b9e-0174d88ea561 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:46.348989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d5f99735-6adc-4a19-8b9e-0174d88ea561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:46.366796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:46.420757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1012/2033] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:46.430810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752602d-1332-4b1d-9fa2-ff82fee7b383 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.431099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752602d-1332-4b1d-9fa2-ff82fee7b383 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.431466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752602d-1332-4b1d-9fa2-ff82fee7b383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.445178 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:46.452602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3752602d-1332-4b1d-9fa2-ff82fee7b383 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:46.454489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3752602d-1332-4b1d-9fa2-ff82fee7b383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:46.465907 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1022/2034] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:46.470374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f99735-6adc-4a19-8b9e-0174d88ea561 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:46.480381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f99735-6adc-4a19-8b9e-0174d88ea561 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:46.485286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2465e3-4cb6-4d2d-91ce-151272ce33a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:46.486101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2465e3-4cb6-4d2d-91ce-151272ce33a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.486407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2465e3-4cb6-4d2d-91ce-151272ce33a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.486681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2465e3-4cb6-4d2d-91ce-151272ce33a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.487527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2465e3-4cb6-4d2d-91ce-151272ce33a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:46.487743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2465e3-4cb6-4d2d-91ce-151272ce33a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:46.489364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2465e3-4cb6-4d2d-91ce-151272ce33a6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:46.502284 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1013/2035] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:19:46.506756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752602d-1332-4b1d-9fa2-ff82fee7b383 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:46.516970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752602d-1332-4b1d-9fa2-ff82fee7b383 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:46.522397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543803f4-c3c3-43fc-bb71-6875f40aee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:46.523052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543803f4-c3c3-43fc-bb71-6875f40aee50 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.523334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543803f4-c3c3-43fc-bb71-6875f40aee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.523602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543803f4-c3c3-43fc-bb71-6875f40aee50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.524294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543803f4-c3c3-43fc-bb71-6875f40aee50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:46.526378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543803f4-c3c3-43fc-bb71-6875f40aee50 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:46.555392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1023/2036] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:46 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:46.556870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2465e3-4cb6-4d2d-91ce-151272ce33a6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:46.567828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2465e3-4cb6-4d2d-91ce-151272ce33a6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:46.632650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acfe33-e75d-4078-8c4d-4da4d47846d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:46.633445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acfe33-e75d-4078-8c4d-4da4d47846d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.633802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acfe33-e75d-4078-8c4d-4da4d47846d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.634149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acfe33-e75d-4078-8c4d-4da4d47846d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.635031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acfe33-e75d-4078-8c4d-4da4d47846d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:46.637443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acfe33-e75d-4078-8c4d-4da4d47846d1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:46.662791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1014/2037] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:46 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:46.664331 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543803f4-c3c3-43fc-bb71-6875f40aee50 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:46.678124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543803f4-c3c3-43fc-bb71-6875f40aee50 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:46.683115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dedd7-e3b6-403b-8acd-03c7c14b7105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:46.683803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dedd7-e3b6-403b-8acd-03c7c14b7105 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.684085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dedd7-e3b6-403b-8acd-03c7c14b7105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.684356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dedd7-e3b6-403b-8acd-03c7c14b7105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.685193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dedd7-e3b6-403b-8acd-03c7c14b7105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:46.686802 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dedd7-e3b6-403b-8acd-03c7c14b7105 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:46.699194 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1024/2038] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:46.703210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acfe33-e75d-4078-8c4d-4da4d47846d1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:46.713889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acfe33-e75d-4078-8c4d-4da4d47846d1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:46.719162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a0965-6069-4a18-901c-1fb2eab6eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:46.719866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0965-6069-4a18-901c-1fb2eab6eb43 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.720169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0965-6069-4a18-901c-1fb2eab6eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.720477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0965-6069-4a18-901c-1fb2eab6eb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.721256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a0965-6069-4a18-901c-1fb2eab6eb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:46.722948 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a0965-6069-4a18-901c-1fb2eab6eb43 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:46.734560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1015/2039] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:46.739492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dedd7-e3b6-403b-8acd-03c7c14b7105 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:46.754294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dedd7-e3b6-403b-8acd-03c7c14b7105 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:46.764637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040202-81ae-49b4-8eee-d29a07d81e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:46.764637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040202-81ae-49b4-8eee-d29a07d81e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.764637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040202-81ae-49b4-8eee-d29a07d81e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.764637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040202-81ae-49b4-8eee-d29a07d81e4c admin admin] PATH_INFO: `/v3/projects/efd4bc74f1d44cdb9f3694bed03f6577/users/98470b067e83462d83aef939339fe4d8/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.780074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6040202-81ae-49b4-8eee-d29a07d81e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd4bc74f1d44cdb9f3694bed03f6577, user_id=98470b067e83462d83aef939339fe4d8, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:46.782765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6040202-81ae-49b4-8eee-d29a07d81e4c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:46.797706 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1025/2040] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:46 2022] PUT /identity/v3/projects/efd4bc74f1d44cdb9f3694bed03f6577/users/98470b067e83462d83aef939339fe4d8/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:46.802832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bfc2d-c4db-435a-b861-4aea43e77065 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.803118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bfc2d-c4db-435a-b861-4aea43e77065 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.803428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bfc2d-c4db-435a-b861-4aea43e77065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.821229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-793bfc2d-c4db-435a-b861-4aea43e77065 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:46.822727 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-793bfc2d-c4db-435a-b861-4aea43e77065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:46.894507 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1016/2041] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:46.904637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040202-81ae-49b4-8eee-d29a07d81e4c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:46.906698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d6040202-81ae-49b4-8eee-d29a07d81e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:46.973057 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040202-81ae-49b4-8eee-d29a07d81e4c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:46.977527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b620-06b5-4e1c-bd51-dee1702fa2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:46.978182 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b620-06b5-4e1c-bd51-dee1702fa2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:46.978487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b620-06b5-4e1c-bd51-dee1702fa2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:46.978758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b620-06b5-4e1c-bd51-dee1702fa2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:46.988587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b620-06b5-4e1c-bd51-dee1702fa2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:46.990058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b620-06b5-4e1c-bd51-dee1702fa2c3 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:47.000295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1026/2042] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:47.642381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e76057-ebfb-4960-bc3a-7cbccde288dc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:47.642674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e76057-ebfb-4960-bc3a-7cbccde288dc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:47.642958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e76057-ebfb-4960-bc3a-7cbccde288dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:47.672488 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-25e76057-ebfb-4960-bc3a-7cbccde288dc None None] MFA Rules not processed for user `98470b067e83462d83aef939339fe4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:47.673822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-25e76057-ebfb-4960-bc3a-7cbccde288dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:47.687900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:47.755300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1017/2043] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:47.760149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b620-06b5-4e1c-bd51-dee1702fa2c3 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:47.770197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b620-06b5-4e1c-bd51-dee1702fa2c3 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:47.774924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d785e-5aa5-41ba-8f27-3f6d6869bfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:47.775881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d785e-5aa5-41ba-8f27-3f6d6869bfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:47.776170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d785e-5aa5-41ba-8f27-3f6d6869bfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:47.776444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d785e-5aa5-41ba-8f27-3f6d6869bfb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:47.777200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d785e-5aa5-41ba-8f27-3f6d6869bfb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:47.779304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d785e-5aa5-41ba-8f27-3f6d6869bfb2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:47.812243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1027/2044] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:47 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:47.813596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e76057-ebfb-4960-bc3a-7cbccde288dc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:47.826074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e76057-ebfb-4960-bc3a-7cbccde288dc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:47.888754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168d520-e604-4e91-b9b4-1d85e408daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:47.889439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d520-e604-4e91-b9b4-1d85e408daf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:47.889728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d520-e604-4e91-b9b4-1d85e408daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:47.890000 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d520-e604-4e91-b9b4-1d85e408daf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:47.890705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168d520-e604-4e91-b9b4-1d85e408daf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:47.892731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168d520-e604-4e91-b9b4-1d85e408daf0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:47.913104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1018/2045] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:47 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:47.917929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d785e-5aa5-41ba-8f27-3f6d6869bfb2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:47.929110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d785e-5aa5-41ba-8f27-3f6d6869bfb2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:47.934929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1ee7f-811f-423e-8ef3-9aaac9d1155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:47.935606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1ee7f-811f-423e-8ef3-9aaac9d1155f admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:47.935896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1ee7f-811f-423e-8ef3-9aaac9d1155f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:47.936172 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1ee7f-811f-423e-8ef3-9aaac9d1155f admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:47.936950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1ee7f-811f-423e-8ef3-9aaac9d1155f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:47.938583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1ee7f-811f-423e-8ef3-9aaac9d1155f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:47.952377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1028/2046] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:47.956983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168d520-e604-4e91-b9b4-1d85e408daf0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:47.967615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168d520-e604-4e91-b9b4-1d85e408daf0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:47.972298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ab0a3-ebcb-4deb-8a45-f1b152ad15df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:47.973257 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ab0a3-ebcb-4deb-8a45-f1b152ad15df admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:47.973576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ab0a3-ebcb-4deb-8a45-f1b152ad15df admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:47.973862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ab0a3-ebcb-4deb-8a45-f1b152ad15df admin admin] PATH_INFO: `/v3/projects/6877c902079147e88c851567adf464a2/users/c3daaf6b94284135a1702e05ca21b9a3/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:47.988691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ab0a3-ebcb-4deb-8a45-f1b152ad15df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6877c902079147e88c851567adf464a2, user_id=c3daaf6b94284135a1702e05ca21b9a3, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:47.991394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ab0a3-ebcb-4deb-8a45-f1b152ad15df admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:48.007032 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1019/2047] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:47 2022] PUT /identity/v3/projects/6877c902079147e88c851567adf464a2/users/c3daaf6b94284135a1702e05ca21b9a3/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:48.012075 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1ee7f-811f-423e-8ef3-9aaac9d1155f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:48.023880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1ee7f-811f-423e-8ef3-9aaac9d1155f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:48.084068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e4ca9-1964-4073-a7a9-8af54d879b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:48.084811 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4ca9-1964-4073-a7a9-8af54d879b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:48.085098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4ca9-1964-4073-a7a9-8af54d879b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:48.085366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4ca9-1964-4073-a7a9-8af54d879b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:48.086115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e4ca9-1964-4073-a7a9-8af54d879b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:48.087805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e4ca9-1964-4073-a7a9-8af54d879b11 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:48.101914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1029/2048] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:48.103778 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ab0a3-ebcb-4deb-8a45-f1b152ad15df admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:48.117896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ab0a3-ebcb-4deb-8a45-f1b152ad15df admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:48.123381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782bfad-8650-4f18-95b0-222e053905a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:48.124516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782bfad-8650-4f18-95b0-222e053905a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:48.124834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782bfad-8650-4f18-95b0-222e053905a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:48.125112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782bfad-8650-4f18-95b0-222e053905a2 admin admin] PATH_INFO: `/v3/projects/6877c902079147e88c851567adf464a2/users/c3daaf6b94284135a1702e05ca21b9a3/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:48.127367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782bfad-8650-4f18-95b0-222e053905a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6877c902079147e88c851567adf464a2, user_id=c3daaf6b94284135a1702e05ca21b9a3, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:48.130159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782bfad-8650-4f18-95b0-222e053905a2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:48.142378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1020/2049] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:48 2022] PUT /identity/v3/projects/6877c902079147e88c851567adf464a2/users/c3daaf6b94284135a1702e05ca21b9a3/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:48.821279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfe93e-70ac-47e7-82c8-1db58a393149 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:48.822315 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfe93e-70ac-47e7-82c8-1db58a393149 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:48.822788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfe93e-70ac-47e7-82c8-1db58a393149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:48.842989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:48.852535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3ecfe93e-70ac-47e7-82c8-1db58a393149 None None] MFA Rules not processed for user `c3daaf6b94284135a1702e05ca21b9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:48.855151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3ecfe93e-70ac-47e7-82c8-1db58a393149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:48.951430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1030/2050] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:49.721479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db703cac-11ac-41a2-b7e1-f7d80f94051a None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:49.722031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db703cac-11ac-41a2-b7e1-f7d80f94051a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:49.722288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db703cac-11ac-41a2-b7e1-f7d80f94051a None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:49.724263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1021/2051] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:19:49.916013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327f4fd-3a03-4413-8fb6-39619dd124f4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:49.917039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327f4fd-3a03-4413-8fb6-39619dd124f4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:49.917039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327f4fd-3a03-4413-8fb6-39619dd124f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:49.936543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7327f4fd-3a03-4413-8fb6-39619dd124f4 None None] MFA Rules not processed for user `58986e97f4d849aba35149d3666db015`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:49.937765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7327f4fd-3a03-4413-8fb6-39619dd124f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:50.015797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1031/2052] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:19:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:50.028422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db703cac-11ac-41a2-b7e1-f7d80f94051a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:50.030255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-db703cac-11ac-41a2-b7e1-f7d80f94051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:50.047928 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db703cac-11ac-41a2-b7e1-f7d80f94051a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:50.053234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b34bc-630c-4fdd-adbb-ed51f7d0766c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:50.053951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b34bc-630c-4fdd-adbb-ed51f7d0766c service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:50.054242 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b34bc-630c-4fdd-adbb-ed51f7d0766c service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:50.054519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b34bc-630c-4fdd-adbb-ed51f7d0766c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:50.064103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b34bc-630c-4fdd-adbb-ed51f7d0766c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:50.065780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b34bc-630c-4fdd-adbb-ed51f7d0766c service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:50.075979 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1022/2053] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:50.546493 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327f4fd-3a03-4413-8fb6-39619dd124f4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:50.616695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327f4fd-3a03-4413-8fb6-39619dd124f4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:50.623473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:50.623866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:50.624145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:50.624416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] PATH_INFO: `/v3/users/98470b067e83462d83aef939339fe4d8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:50.625768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98470b067e83462d83aef939339fe4d8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:50.627702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:50.668385 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:50.682083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98470b067e83462d83aef939339fe4d8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:50.689572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98470b067e83462d83aef939339fe4d8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:50.690179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98470b067e83462d83aef939339fe4d8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:50.701895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98470b067e83462d83aef939339fe4d8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:50.702831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98470b067e83462d83aef939339fe4d8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:50.723145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1032/2054] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:50 2022] DELETE /identity/v3/users/98470b067e83462d83aef939339fe4d8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:50.917264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b34bc-630c-4fdd-adbb-ed51f7d0766c service placement] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:50.930872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b34bc-630c-4fdd-adbb-ed51f7d0766c service placement] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:50.996653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:51.005458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:51.006478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:51.006951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:51.007444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] PATH_INFO: `/v3/projects/efd4bc74f1d44cdb9f3694bed03f6577` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:51.008858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd4bc74f1d44cdb9f3694bed03f6577)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:51.011164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:51.069338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd4bc74f1d44cdb9f3694bed03f6577', 'request_id': 'req-6f0717ee-56ab-413b-8e7b-06e87c90a734'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.077737 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd4bc74f1d44cdb9f3694bed03f6577', 'request_id': 'req-6f0717ee-56ab-413b-8e7b-06e87c90a734'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.084812 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd4bc74f1d44cdb9f3694bed03f6577', 'request_id': 'req-6f0717ee-56ab-413b-8e7b-06e87c90a734'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.097778 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] The token cache is being invalidate because project efd4bc74f1d44cdb9f3694bed03f6577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:51.098133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.099074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.101538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1023/2055] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:50 2022] DELETE /identity/v3/projects/efd4bc74f1d44cdb9f3694bed03f6577 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:51.105759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:51.107362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:51.124018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3c609-5ac0-4b74-a8aa-25408d0da797 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:51.194360 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:51.195247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:51.195528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:51.195804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] PATH_INFO: `/v3/users/c3daaf6b94284135a1702e05ca21b9a3` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:51.197137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3daaf6b94284135a1702e05ca21b9a3)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:51.199242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:51.249604 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3daaf6b94284135a1702e05ca21b9a3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.257673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3daaf6b94284135a1702e05ca21b9a3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.258387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3daaf6b94284135a1702e05ca21b9a3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.266369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3daaf6b94284135a1702e05ca21b9a3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.267085 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-89511958-ac67-4694-b69f-762eeb1da534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3daaf6b94284135a1702e05ca21b9a3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.285497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1033/2056] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:51 2022] DELETE /identity/v3/users/c3daaf6b94284135a1702e05ca21b9a3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:51.491775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:51.494856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:51.508966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0717ee-56ab-413b-8e7b-06e87c90a734 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:51.571562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:51.572822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:51.573125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:51.573404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] PATH_INFO: `/v3/projects/6877c902079147e88c851567adf464a2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:51.574616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6877c902079147e88c851567adf464a2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:51.576562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:51.632322 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6877c902079147e88c851567adf464a2', 'request_id': 'req-07c6ab7a-fe93-42f2-9b39-528894650352'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.641920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6877c902079147e88c851567adf464a2', 'request_id': 'req-07c6ab7a-fe93-42f2-9b39-528894650352'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.649302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6877c902079147e88c851567adf464a2', 'request_id': 'req-07c6ab7a-fe93-42f2-9b39-528894650352'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.660418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] The token cache is being invalidate because project 6877c902079147e88c851567adf464a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:51.660740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.661510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07c6ab7a-fe93-42f2-9b39-528894650352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:51.664466 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1024/2057] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:51 2022] DELETE /identity/v3/projects/6877c902079147e88c851567adf464a2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:51.670264 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a2ec-f829-4dd2-be34-dea185390698 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:51.670767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a2ec-f829-4dd2-be34-dea185390698 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:51.671193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a2ec-f829-4dd2-be34-dea185390698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:51.693698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-eac9a2ec-f829-4dd2-be34-dea185390698 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:51.694940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-eac9a2ec-f829-4dd2-be34-dea185390698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:51.725420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:51.786231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1034/2058] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:51.788502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5561e-f6f2-4cd4-b60b-b14db00f812a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:51.788826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5561e-f6f2-4cd4-b60b-b14db00f812a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:51.789107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5561e-f6f2-4cd4-b60b-b14db00f812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:51.812390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e0d5561e-f6f2-4cd4-b60b-b14db00f812a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:51.813895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e0d5561e-f6f2-4cd4-b60b-b14db00f812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:51.822492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1025/2059] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:51.826999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9a2ec-f829-4dd2-be34-dea185390698 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:51.836971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9a2ec-f829-4dd2-be34-dea185390698 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:51.842144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde0ce9-1b20-452e-bad6-2092976bc513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:51.842826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0ce9-1b20-452e-bad6-2092976bc513 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:51.843103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0ce9-1b20-452e-bad6-2092976bc513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:51.843377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0ce9-1b20-452e-bad6-2092976bc513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:51.844130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde0ce9-1b20-452e-bad6-2092976bc513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:51.844452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde0ce9-1b20-452e-bad6-2092976bc513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:51.846094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde0ce9-1b20-452e-bad6-2092976bc513 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:51.861830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1035/2060] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:51.863521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5561e-f6f2-4cd4-b60b-b14db00f812a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:51.873758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5561e-f6f2-4cd4-b60b-b14db00f812a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:51.879508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819bfb5-e967-4320-a0f6-810790fcfea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:51.880182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819bfb5-e967-4320-a0f6-810790fcfea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:51.880519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819bfb5-e967-4320-a0f6-810790fcfea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:51.880799 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819bfb5-e967-4320-a0f6-810790fcfea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:51.881781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819bfb5-e967-4320-a0f6-810790fcfea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:51.884007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819bfb5-e967-4320-a0f6-810790fcfea7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:51.890657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:51.921224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1026/2061] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:51 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:51.925579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde0ce9-1b20-452e-bad6-2092976bc513 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:51.941434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde0ce9-1b20-452e-bad6-2092976bc513 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.003640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab57f1-1b52-431a-9667-cd907720a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.004385 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab57f1-1b52-431a-9667-cd907720a899 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.004612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab57f1-1b52-431a-9667-cd907720a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.004940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab57f1-1b52-431a-9667-cd907720a899 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.005656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab57f1-1b52-431a-9667-cd907720a899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.007586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab57f1-1b52-431a-9667-cd907720a899 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:52.032783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1036/2062] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:51 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:52.035408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819bfb5-e967-4320-a0f6-810790fcfea7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:52.046248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819bfb5-e967-4320-a0f6-810790fcfea7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.051339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6a70b-264e-4b57-868c-59d859296544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.052004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6a70b-264e-4b57-868c-59d859296544 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.052284 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6a70b-264e-4b57-868c-59d859296544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.052557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6a70b-264e-4b57-868c-59d859296544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.053299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6a70b-264e-4b57-868c-59d859296544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.054919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6a70b-264e-4b57-868c-59d859296544 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:52.065641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1027/2063] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:52.070412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab57f1-1b52-431a-9667-cd907720a899 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:52.082602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab57f1-1b52-431a-9667-cd907720a899 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.088218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85919006-517d-4ec5-88cf-04ffd5ae2cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.089446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85919006-517d-4ec5-88cf-04ffd5ae2cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.089741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85919006-517d-4ec5-88cf-04ffd5ae2cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.090020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85919006-517d-4ec5-88cf-04ffd5ae2cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.090754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85919006-517d-4ec5-88cf-04ffd5ae2cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.092346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85919006-517d-4ec5-88cf-04ffd5ae2cc3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:52.102620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1037/2064] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:52.107033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6a70b-264e-4b57-868c-59d859296544 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:52.118053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6a70b-264e-4b57-868c-59d859296544 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.123456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd64c3-bb8c-4a79-8998-0ca453ba1dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.124354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd64c3-bb8c-4a79-8998-0ca453ba1dce admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.124634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd64c3-bb8c-4a79-8998-0ca453ba1dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.125014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd64c3-bb8c-4a79-8998-0ca453ba1dce admin admin] PATH_INFO: `/v3/projects/09d03562fa7f485dbd917a05a5ed7da5/users/19a7568cac534868b07f17c436e80547/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.144400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd64c3-bb8c-4a79-8998-0ca453ba1dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d03562fa7f485dbd917a05a5ed7da5, user_id=19a7568cac534868b07f17c436e80547, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.147095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd64c3-bb8c-4a79-8998-0ca453ba1dce admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:52.161085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1028/2065] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:52 2022] PUT /identity/v3/projects/09d03562fa7f485dbd917a05a5ed7da5/users/19a7568cac534868b07f17c436e80547/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:52.171451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a511-435d-4540-9a80-4ec1af6eaa72 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.171913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a511-435d-4540-9a80-4ec1af6eaa72 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.172003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a511-435d-4540-9a80-4ec1af6eaa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.199204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e6e8a511-435d-4540-9a80-4ec1af6eaa72 None None] MFA Rules not processed for user `19a7568cac534868b07f17c436e80547`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:52.200615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e6e8a511-435d-4540-9a80-4ec1af6eaa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:52.274749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1038/2066] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:52.280890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd64c3-bb8c-4a79-8998-0ca453ba1dce admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:52.354055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd64c3-bb8c-4a79-8998-0ca453ba1dce admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.359531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75f6db-9788-46f0-8ebb-b499f675459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.360199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75f6db-9788-46f0-8ebb-b499f675459f admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.360951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75f6db-9788-46f0-8ebb-b499f675459f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.361229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75f6db-9788-46f0-8ebb-b499f675459f admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.361922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75f6db-9788-46f0-8ebb-b499f675459f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.363817 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75f6db-9788-46f0-8ebb-b499f675459f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:52.396242 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1029/2067] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:52 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:52.397524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8a511-435d-4540-9a80-4ec1af6eaa72 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:52.409872 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8a511-435d-4540-9a80-4ec1af6eaa72 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.435942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:52.477875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ffe7f-e98c-4621-8afb-ab46beda0706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.478557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ffe7f-e98c-4621-8afb-ab46beda0706 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.478842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ffe7f-e98c-4621-8afb-ab46beda0706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.479115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ffe7f-e98c-4621-8afb-ab46beda0706 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.480333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ffe7f-e98c-4621-8afb-ab46beda0706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.482281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ffe7f-e98c-4621-8afb-ab46beda0706 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:52.505102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1039/2068] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:52 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:52.509223 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75f6db-9788-46f0-8ebb-b499f675459f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:52.521154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75f6db-9788-46f0-8ebb-b499f675459f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.526632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c55b-8c8a-4e93-8462-64ddc27b5c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.527379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c55b-8c8a-4e93-8462-64ddc27b5c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.527720 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c55b-8c8a-4e93-8462-64ddc27b5c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.528113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c55b-8c8a-4e93-8462-64ddc27b5c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.529034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9c55b-8c8a-4e93-8462-64ddc27b5c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.530761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9c55b-8c8a-4e93-8462-64ddc27b5c21 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:52.542046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1030/2069] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:52.548918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ffe7f-e98c-4621-8afb-ab46beda0706 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:52.559519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ffe7f-e98c-4621-8afb-ab46beda0706 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.564578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a06f-bd0b-49c7-ae7e-2123ae2b2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.565495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a06f-bd0b-49c7-ae7e-2123ae2b2479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.565770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a06f-bd0b-49c7-ae7e-2123ae2b2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.566042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a06f-bd0b-49c7-ae7e-2123ae2b2479 admin admin] PATH_INFO: `/v3/projects/f861e1f6fc4d4591ac8ee80249361828/users/b6d9ba518fa243c3ae3389ff98afc7cb/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.581576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836a06f-bd0b-49c7-ae7e-2123ae2b2479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f861e1f6fc4d4591ac8ee80249361828, user_id=b6d9ba518fa243c3ae3389ff98afc7cb, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.584247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836a06f-bd0b-49c7-ae7e-2123ae2b2479 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:52.602505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1040/2070] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:52 2022] PUT /identity/v3/projects/f861e1f6fc4d4591ac8ee80249361828/users/b6d9ba518fa243c3ae3389ff98afc7cb/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:52.606989 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c55b-8c8a-4e93-8462-64ddc27b5c21 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:52.618519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c55b-8c8a-4e93-8462-64ddc27b5c21 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.680221 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087bff0-9d73-4d30-a53f-d4c6d270118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.680932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087bff0-9d73-4d30-a53f-d4c6d270118f admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.681236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087bff0-9d73-4d30-a53f-d4c6d270118f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.681516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087bff0-9d73-4d30-a53f-d4c6d270118f admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.682249 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087bff0-9d73-4d30-a53f-d4c6d270118f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.684383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087bff0-9d73-4d30-a53f-d4c6d270118f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:52.694493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1031/2071] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:52.699311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a06f-bd0b-49c7-ae7e-2123ae2b2479 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:52.710175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a06f-bd0b-49c7-ae7e-2123ae2b2479 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.715691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3b4ba-5e20-4829-be20-d6d13d5f09ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.716596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3b4ba-5e20-4829-be20-d6d13d5f09ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.716926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3b4ba-5e20-4829-be20-d6d13d5f09ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.717182 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3b4ba-5e20-4829-be20-d6d13d5f09ef admin admin] PATH_INFO: `/v3/projects/f861e1f6fc4d4591ac8ee80249361828/users/b6d9ba518fa243c3ae3389ff98afc7cb/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.719203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3b4ba-5e20-4829-be20-d6d13d5f09ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f861e1f6fc4d4591ac8ee80249361828, user_id=b6d9ba518fa243c3ae3389ff98afc7cb, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.721876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3b4ba-5e20-4829-be20-d6d13d5f09ef admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:52.737029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1041/2072] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:52 2022] PUT /identity/v3/projects/f861e1f6fc4d4591ac8ee80249361828/users/b6d9ba518fa243c3ae3389ff98afc7cb/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:52.749373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfbdb5-930a-4826-b7a9-93676d6cfc52 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.749662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfbdb5-930a-4826-b7a9-93676d6cfc52 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.749950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfbdb5-930a-4826-b7a9-93676d6cfc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.780728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-51bfbdb5-930a-4826-b7a9-93676d6cfc52 None None] MFA Rules not processed for user `b6d9ba518fa243c3ae3389ff98afc7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:52.781869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-51bfbdb5-930a-4826-b7a9-93676d6cfc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:52.791965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:52.865366 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1032/2073] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:52.884196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3b4ba-5e20-4829-be20-d6d13d5f09ef admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:52.886959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2ea3b4ba-5e20-4829-be20-d6d13d5f09ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:52.977729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3b4ba-5e20-4829-be20-d6d13d5f09ef admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:52.982006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a610f-7411-4ba4-be81-227bfc1b600f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:52.982657 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a610f-7411-4ba4-be81-227bfc1b600f service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:52.982939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a610f-7411-4ba4-be81-227bfc1b600f service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:52.983216 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a610f-7411-4ba4-be81-227bfc1b600f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:52.992549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a610f-7411-4ba4-be81-227bfc1b600f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:52.994018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a610f-7411-4ba4-be81-227bfc1b600f service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:53.005283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1042/2074] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:53.532594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfbdb5-930a-4826-b7a9-93676d6cfc52 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:53.597237 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfbdb5-930a-4826-b7a9-93676d6cfc52 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:53.602226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:53.603105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:53.603386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:53.603657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] PATH_INFO: `/v3/users/19a7568cac534868b07f17c436e80547` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:53.604993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a7568cac534868b07f17c436e80547)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:53.607084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:53.666825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a7568cac534868b07f17c436e80547'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:53.667962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a7568cac534868b07f17c436e80547'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:53.675646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a7568cac534868b07f17c436e80547'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:53.683096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a7568cac534868b07f17c436e80547'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:53.683730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a7568cac534868b07f17c436e80547'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:53.701797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1033/2075] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:53 2022] DELETE /identity/v3/users/19a7568cac534868b07f17c436e80547 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:53.706531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88668-0a68-4c97-8177-d1bcc6f9ba94 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:53.706993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88668-0a68-4c97-8177-d1bcc6f9ba94 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:53.707098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88668-0a68-4c97-8177-d1bcc6f9ba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:53.726852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cba88668-0a68-4c97-8177-d1bcc6f9ba94 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:53.728092 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cba88668-0a68-4c97-8177-d1bcc6f9ba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:53.794295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1043/2076] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:53.805561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:53.806969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:53.840292 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:53.878513 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a2f46-2157-472b-9eab-50356f0f2b1f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:53.882906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848703d-c2c8-45c4-a8b5-fb6383ed748b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:53.883566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848703d-c2c8-45c4-a8b5-fb6383ed748b service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:53.883823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848703d-c2c8-45c4-a8b5-fb6383ed748b service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:53.884097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848703d-c2c8-45c4-a8b5-fb6383ed748b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:53.894528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848703d-c2c8-45c4-a8b5-fb6383ed748b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:53.895968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848703d-c2c8-45c4-a8b5-fb6383ed748b service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:53.906583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1034/2077] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:54.195424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba88668-0a68-4c97-8177-d1bcc6f9ba94 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:54.196965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cba88668-0a68-4c97-8177-d1bcc6f9ba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:54.210916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba88668-0a68-4c97-8177-d1bcc6f9ba94 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:54.217038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:54.217985 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:54.218329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:54.218602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] PATH_INFO: `/v3/projects/09d03562fa7f485dbd917a05a5ed7da5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:54.219913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d03562fa7f485dbd917a05a5ed7da5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:54.222095 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:54.251014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:54.299738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d03562fa7f485dbd917a05a5ed7da5', 'request_id': 'req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:54.309807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d03562fa7f485dbd917a05a5ed7da5', 'request_id': 'req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:54.319117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d03562fa7f485dbd917a05a5ed7da5', 'request_id': 'req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:54.335596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] The token cache is being invalidate because project 09d03562fa7f485dbd917a05a5ed7da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:54.336214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:54.337076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:54.339396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1044/2078] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:54 2022] DELETE /identity/v3/projects/09d03562fa7f485dbd917a05a5ed7da5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:54.343713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848703d-c2c8-45c4-a8b5-fb6383ed748b service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:54.361739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848703d-c2c8-45c4-a8b5-fb6383ed748b service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:54.450548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:54.451452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:54.451739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:54.452019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] PATH_INFO: `/v3/users/b6d9ba518fa243c3ae3389ff98afc7cb` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:54.453263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d9ba518fa243c3ae3389ff98afc7cb)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:54.455253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:54.510288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d9ba518fa243c3ae3389ff98afc7cb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:54.512770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d9ba518fa243c3ae3389ff98afc7cb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:54.521243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d9ba518fa243c3ae3389ff98afc7cb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:54.536263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d9ba518fa243c3ae3389ff98afc7cb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:54.537212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-74cfa348-c6e1-4cbc-9d14-f15c2f626809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d9ba518fa243c3ae3389ff98afc7cb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:54.561430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1035/2079] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:54 2022] DELETE /identity/v3/users/b6d9ba518fa243c3ae3389ff98afc7cb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:54.846595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:54.848074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:54.862494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1facf2-ff7f-4b6b-9b50-6c4240db804b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:54.924258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:54.925173 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:54.925458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:54.925733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] PATH_INFO: `/v3/projects/f861e1f6fc4d4591ac8ee80249361828` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:54.926943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f861e1f6fc4d4591ac8ee80249361828)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:54.928892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.005902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f861e1f6fc4d4591ac8ee80249361828', 'request_id': 'req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:55.012638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f861e1f6fc4d4591ac8ee80249361828', 'request_id': 'req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:55.021417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f861e1f6fc4d4591ac8ee80249361828', 'request_id': 'req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:55.034750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] The token cache is being invalidate because project f861e1f6fc4d4591ac8ee80249361828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:55.035036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:55.035761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7796ae8a-e85a-4d4d-8650-a0177cb0c81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:55.037398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1045/2080] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:54 2022] DELETE /identity/v3/projects/f861e1f6fc4d4591ac8ee80249361828 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:55.042524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab034-2451-4733-87b5-8c7a3e91fa74 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.043005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab034-2451-4733-87b5-8c7a3e91fa74 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.043293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab034-2451-4733-87b5-8c7a3e91fa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.061584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-677ab034-2451-4733-87b5-8c7a3e91fa74 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:55.062808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-677ab034-2451-4733-87b5-8c7a3e91fa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:55.109198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:55.127581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1036/2081] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:55.135375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd8ae7-4d45-409d-b430-bb00489bc3a3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.135689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd8ae7-4d45-409d-b430-bb00489bc3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.136704 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd8ae7-4d45-409d-b430-bb00489bc3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.156823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-54cd8ae7-4d45-409d-b430-bb00489bc3a3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:55.158034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-54cd8ae7-4d45-409d-b430-bb00489bc3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:55.167073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1046/2082] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:55.171387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ab034-2451-4733-87b5-8c7a3e91fa74 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.181611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ab034-2451-4733-87b5-8c7a3e91fa74 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:55.186559 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee42f-5748-4966-8f09-ddef7091aa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:55.187369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee42f-5748-4966-8f09-ddef7091aa96 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.187659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee42f-5748-4966-8f09-ddef7091aa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.187935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee42f-5748-4966-8f09-ddef7091aa96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.188738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ee42f-5748-4966-8f09-ddef7091aa96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:55.189049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ee42f-5748-4966-8f09-ddef7091aa96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:55.190683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ee42f-5748-4966-8f09-ddef7091aa96 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.203282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1037/2083] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:55.207674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd8ae7-4d45-409d-b430-bb00489bc3a3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.216941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd8ae7-4d45-409d-b430-bb00489bc3a3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:55.221804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecc701-922c-4ef7-97d6-6cec9d47b8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:55.222575 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc701-922c-4ef7-97d6-6cec9d47b8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.222859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc701-922c-4ef7-97d6-6cec9d47b8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.223129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc701-922c-4ef7-97d6-6cec9d47b8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.223909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecc701-922c-4ef7-97d6-6cec9d47b8f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:55.226109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecc701-922c-4ef7-97d6-6cec9d47b8f8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.255077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1047/2084] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:55 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:19:55.259267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee42f-5748-4966-8f09-ddef7091aa96 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.270352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee42f-5748-4966-8f09-ddef7091aa96 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:55.341784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a904d2-5f3f-47a6-9766-0d574230a592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:55.342466 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a904d2-5f3f-47a6-9766-0d574230a592 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.342757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a904d2-5f3f-47a6-9766-0d574230a592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.343031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a904d2-5f3f-47a6-9766-0d574230a592 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.343784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a904d2-5f3f-47a6-9766-0d574230a592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:55.345705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a904d2-5f3f-47a6-9766-0d574230a592 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.367320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1038/2085] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:55 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:55.371977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecc701-922c-4ef7-97d6-6cec9d47b8f8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.385586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:55.392078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecc701-922c-4ef7-97d6-6cec9d47b8f8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:55.403941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4199429-d659-4ca0-95d9-654dab52ae5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:55.404770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4199429-d659-4ca0-95d9-654dab52ae5a admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.405055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4199429-d659-4ca0-95d9-654dab52ae5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.405373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4199429-d659-4ca0-95d9-654dab52ae5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.406140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4199429-d659-4ca0-95d9-654dab52ae5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:55.407760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4199429-d659-4ca0-95d9-654dab52ae5a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.420602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1048/2086] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:55.424867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a904d2-5f3f-47a6-9766-0d574230a592 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.435607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a904d2-5f3f-47a6-9766-0d574230a592 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:55.441439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75648a37-5184-4b0e-a32a-5a3bed8e3eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:55.442134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648a37-5184-4b0e-a32a-5a3bed8e3eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.442419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648a37-5184-4b0e-a32a-5a3bed8e3eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.442674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648a37-5184-4b0e-a32a-5a3bed8e3eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.443417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648a37-5184-4b0e-a32a-5a3bed8e3eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:55.445127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648a37-5184-4b0e-a32a-5a3bed8e3eb1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.456700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1039/2087] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:55.461595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4199429-d659-4ca0-95d9-654dab52ae5a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.473431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4199429-d659-4ca0-95d9-654dab52ae5a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:55.478636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a06d9-d476-4875-86b6-59b620a772b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:55.479725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a06d9-d476-4875-86b6-59b620a772b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.480743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a06d9-d476-4875-86b6-59b620a772b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.481475 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a06d9-d476-4875-86b6-59b620a772b6 admin admin] PATH_INFO: `/v3/projects/9f199eb1120d4f2498b3ff8cd6b7768b/users/bb670c0fb9524147a9a52a4a962d735b/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.501292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a06d9-d476-4875-86b6-59b620a772b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f199eb1120d4f2498b3ff8cd6b7768b, user_id=bb670c0fb9524147a9a52a4a962d735b, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:55.504103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a06d9-d476-4875-86b6-59b620a772b6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.519630 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1049/2088] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:55 2022] PUT /identity/v3/projects/9f199eb1120d4f2498b3ff8cd6b7768b/users/bb670c0fb9524147a9a52a4a962d735b/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:55.530171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d8e22-3ead-4558-bb51-0605b4d4c676 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.530412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d8e22-3ead-4558-bb51-0605b4d4c676 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.530699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d8e22-3ead-4558-bb51-0605b4d4c676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.557976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-129d8e22-3ead-4558-bb51-0605b4d4c676 None None] MFA Rules not processed for user `bb670c0fb9524147a9a52a4a962d735b`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:55.559226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-129d8e22-3ead-4558-bb51-0605b4d4c676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:55.633995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1040/2089] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:55.634944 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a06d9-d476-4875-86b6-59b620a772b6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.710991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a06d9-d476-4875-86b6-59b620a772b6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:55.715660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8b64d-9819-4dac-abaa-54ce7430b0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:55.716743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b64d-9819-4dac-abaa-54ce7430b0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.717064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b64d-9819-4dac-abaa-54ce7430b0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.717345 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b64d-9819-4dac-abaa-54ce7430b0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.718044 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8b64d-9819-4dac-abaa-54ce7430b0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:55.719955 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8b64d-9819-4dac-abaa-54ce7430b0f3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.749552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1050/2090] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:55 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:55.751089 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d8e22-3ead-4558-bb51-0605b4d4c676 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.762192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d8e22-3ead-4558-bb51-0605b4d4c676 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:55.807830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:55.825328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99666286-ab0b-4556-af45-46236ea21d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:55.826011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99666286-ab0b-4556-af45-46236ea21d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.826300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99666286-ab0b-4556-af45-46236ea21d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.826570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99666286-ab0b-4556-af45-46236ea21d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.827279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99666286-ab0b-4556-af45-46236ea21d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:55.829252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99666286-ab0b-4556-af45-46236ea21d96 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.849619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1041/2091] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:55 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:55.853650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8b64d-9819-4dac-abaa-54ce7430b0f3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.864760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8b64d-9819-4dac-abaa-54ce7430b0f3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:55.870619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df4ece-e6f8-49da-87c7-cdf44d756dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:55.871476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df4ece-e6f8-49da-87c7-cdf44d756dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.871762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df4ece-e6f8-49da-87c7-cdf44d756dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.872026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df4ece-e6f8-49da-87c7-cdf44d756dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.872782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df4ece-e6f8-49da-87c7-cdf44d756dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:55.874366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df4ece-e6f8-49da-87c7-cdf44d756dcb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.888089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1051/2092] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:55.892517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99666286-ab0b-4556-af45-46236ea21d96 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.904043 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99666286-ab0b-4556-af45-46236ea21d96 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:55.909701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6ffe1-a154-4973-95ab-eeb5d7614bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:55.910602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6ffe1-a154-4973-95ab-eeb5d7614bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:55.910895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6ffe1-a154-4973-95ab-eeb5d7614bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:55.911172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6ffe1-a154-4973-95ab-eeb5d7614bfd admin admin] PATH_INFO: `/v3/projects/bec24ae5584e43e3b50cdc5a386712b9/users/6b98bd1aa51f478892f413f21803cd78/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:55.928438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6ffe1-a154-4973-95ab-eeb5d7614bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec24ae5584e43e3b50cdc5a386712b9, user_id=6b98bd1aa51f478892f413f21803cd78, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:55.931150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6ffe1-a154-4973-95ab-eeb5d7614bfd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:55.950090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1042/2093] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:55 2022] PUT /identity/v3/projects/bec24ae5584e43e3b50cdc5a386712b9/users/6b98bd1aa51f478892f413f21803cd78/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:55.956301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df4ece-e6f8-49da-87c7-cdf44d756dcb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:55.967644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df4ece-e6f8-49da-87c7-cdf44d756dcb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:56.031576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a4611-0b2b-441b-b80b-5b1593fac1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:56.032253 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a4611-0b2b-441b-b80b-5b1593fac1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:56.032540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a4611-0b2b-441b-b80b-5b1593fac1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:56.032864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a4611-0b2b-441b-b80b-5b1593fac1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:56.033634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a4611-0b2b-441b-b80b-5b1593fac1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:56.035293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a4611-0b2b-441b-b80b-5b1593fac1a4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:56.045688 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1052/2094] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:56.050372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6ffe1-a154-4973-95ab-eeb5d7614bfd admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:56.063675 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6ffe1-a154-4973-95ab-eeb5d7614bfd admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:56.069146 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a919d-fd65-4474-a7b9-3606758d3c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:56.070171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a919d-fd65-4474-a7b9-3606758d3c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:56.070456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a919d-fd65-4474-a7b9-3606758d3c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:56.070731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a919d-fd65-4474-a7b9-3606758d3c5e admin admin] PATH_INFO: `/v3/projects/bec24ae5584e43e3b50cdc5a386712b9/users/6b98bd1aa51f478892f413f21803cd78/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:56.072689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a919d-fd65-4474-a7b9-3606758d3c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec24ae5584e43e3b50cdc5a386712b9, user_id=6b98bd1aa51f478892f413f21803cd78, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:56.075454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a919d-fd65-4474-a7b9-3606758d3c5e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:56.085689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1043/2095] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:56 2022] PUT /identity/v3/projects/bec24ae5584e43e3b50cdc5a386712b9/users/6b98bd1aa51f478892f413f21803cd78/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:56.097511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11138df-a3a4-475d-bb21-42eb8fbc3662 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:56.097827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11138df-a3a4-475d-bb21-42eb8fbc3662 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:56.098099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11138df-a3a4-475d-bb21-42eb8fbc3662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:56.132068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f11138df-a3a4-475d-bb21-42eb8fbc3662 None None] MFA Rules not processed for user `6b98bd1aa51f478892f413f21803cd78`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:56.133317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f11138df-a3a4-475d-bb21-42eb8fbc3662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:56.166830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:56.213376 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1053/2096] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:56.228442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a919d-fd65-4474-a7b9-3606758d3c5e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:56.230650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2d9a919d-fd65-4474-a7b9-3606758d3c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:56.290493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a919d-fd65-4474-a7b9-3606758d3c5e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:56.294432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944806ad-0deb-4b35-95ef-a3cef8bf6956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:56.295094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944806ad-0deb-4b35-95ef-a3cef8bf6956 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:56.295381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944806ad-0deb-4b35-95ef-a3cef8bf6956 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:56.295660 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944806ad-0deb-4b35-95ef-a3cef8bf6956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:56.304914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944806ad-0deb-4b35-95ef-a3cef8bf6956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:56.306374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944806ad-0deb-4b35-95ef-a3cef8bf6956 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:56.316132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1044/2097] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:56.390221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11138df-a3a4-475d-bb21-42eb8fbc3662 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:56.454508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11138df-a3a4-475d-bb21-42eb8fbc3662 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:56.459382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:56.460276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:56.460572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:56.460881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] PATH_INFO: `/v3/users/bb670c0fb9524147a9a52a4a962d735b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:56.462127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb670c0fb9524147a9a52a4a962d735b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:56.464063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:56.512435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb670c0fb9524147a9a52a4a962d735b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:56.522043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb670c0fb9524147a9a52a4a962d735b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:56.522750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb670c0fb9524147a9a52a4a962d735b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:56.529711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb670c0fb9524147a9a52a4a962d735b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:56.530326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb670c0fb9524147a9a52a4a962d735b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:56.547935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1054/2098] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:56 2022] DELETE /identity/v3/users/bb670c0fb9524147a9a52a4a962d735b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:56.552852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3372-bbdc-40f5-a611-7696b6b917c6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:56.553172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3372-bbdc-40f5-a611-7696b6b917c6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:56.553553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3372-bbdc-40f5-a611-7696b6b917c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:56.572930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-766f3372-bbdc-40f5-a611-7696b6b917c6 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:56.574326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-766f3372-bbdc-40f5-a611-7696b6b917c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:56.650850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1045/2099] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:56.661755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:56.663238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:56.720155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:56.734494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463eff2-2083-4474-9ab5-08e1266420fc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:56.747285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61cee4-0e2c-4814-afa7-6b86f653d7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:56.747963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61cee4-0e2c-4814-afa7-6b86f653d7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:56.748245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61cee4-0e2c-4814-afa7-6b86f653d7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:56.748571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61cee4-0e2c-4814-afa7-6b86f653d7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:56.762537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61cee4-0e2c-4814-afa7-6b86f653d7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:56.764080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61cee4-0e2c-4814-afa7-6b86f653d7a1 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:56.779824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1055/2100] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:57.088165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f3372-bbdc-40f5-a611-7696b6b917c6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:57.089942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-766f3372-bbdc-40f5-a611-7696b6b917c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:57.102264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f3372-bbdc-40f5-a611-7696b6b917c6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:57.107927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:57.108826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:57.109113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:57.109391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] PATH_INFO: `/v3/projects/9f199eb1120d4f2498b3ff8cd6b7768b` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:57.110709 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f199eb1120d4f2498b3ff8cd6b7768b)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:57.112621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:57.156842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:57.168114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f199eb1120d4f2498b3ff8cd6b7768b', 'request_id': 'req-3724d2cb-e584-408a-a7ea-1576d3a81149'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.175722 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f199eb1120d4f2498b3ff8cd6b7768b', 'request_id': 'req-3724d2cb-e584-408a-a7ea-1576d3a81149'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.182476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f199eb1120d4f2498b3ff8cd6b7768b', 'request_id': 'req-3724d2cb-e584-408a-a7ea-1576d3a81149'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.194030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] The token cache is being invalidate because project 9f199eb1120d4f2498b3ff8cd6b7768b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:57.194362 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.195053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.197109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1046/2101] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:57 2022] DELETE /identity/v3/projects/9f199eb1120d4f2498b3ff8cd6b7768b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:57.201479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61cee4-0e2c-4814-afa7-6b86f653d7a1 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:57.211638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61cee4-0e2c-4814-afa7-6b86f653d7a1 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:57.275103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:57.276002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:57.276611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:57.276611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] PATH_INFO: `/v3/users/6b98bd1aa51f478892f413f21803cd78` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:57.278105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b98bd1aa51f478892f413f21803cd78)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:57.280025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:57.329314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b98bd1aa51f478892f413f21803cd78'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.337960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b98bd1aa51f478892f413f21803cd78'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.338596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b98bd1aa51f478892f413f21803cd78'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.345747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b98bd1aa51f478892f413f21803cd78'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.346374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a5a448d-d679-4afb-beaa-86543da0f928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b98bd1aa51f478892f413f21803cd78'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.372267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1056/2102] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:57 2022] DELETE /identity/v3/users/6b98bd1aa51f478892f413f21803cd78 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:57.659472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:57.660892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:57.674378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724d2cb-e584-408a-a7ea-1576d3a81149 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:57.739827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:57.740818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:57.741080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:57.741425 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] PATH_INFO: `/v3/projects/bec24ae5584e43e3b50cdc5a386712b9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:57.742894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec24ae5584e43e3b50cdc5a386712b9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:57.744878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:57.795578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec24ae5584e43e3b50cdc5a386712b9', 'request_id': 'req-3a96c0a2-824e-466c-a822-7a3090e2428a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.804775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec24ae5584e43e3b50cdc5a386712b9', 'request_id': 'req-3a96c0a2-824e-466c-a822-7a3090e2428a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.811443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec24ae5584e43e3b50cdc5a386712b9', 'request_id': 'req-3a96c0a2-824e-466c-a822-7a3090e2428a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.828490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] The token cache is being invalidate because project bec24ae5584e43e3b50cdc5a386712b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:57.828816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.829825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3a96c0a2-824e-466c-a822-7a3090e2428a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:57.831452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1047/2103] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:57 2022] DELETE /identity/v3/projects/bec24ae5584e43e3b50cdc5a386712b9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:57.836603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f89d3-6ceb-4265-9a81-d806707cdb7e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:57.836938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f89d3-6ceb-4265-9a81-d806707cdb7e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:57.837245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f89d3-6ceb-4265-9a81-d806707cdb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:57.857699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-303f89d3-6ceb-4265-9a81-d806707cdb7e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:57.858897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-303f89d3-6ceb-4265-9a81-d806707cdb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:57.935576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1057/2104] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:57.946143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17916f-6012-4002-a4c6-e6c4c627aa18 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:57.946429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17916f-6012-4002-a4c6-e6c4c627aa18 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:57.946703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17916f-6012-4002-a4c6-e6c4c627aa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:57.968178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6f17916f-6012-4002-a4c6-e6c4c627aa18 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:57.969519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6f17916f-6012-4002-a4c6-e6c4c627aa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:57.978041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1048/2105] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:57.982464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f89d3-6ceb-4265-9a81-d806707cdb7e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:57.992747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f89d3-6ceb-4265-9a81-d806707cdb7e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:57.997734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37944e5c-a6c1-4252-a832-5991df2307b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:57.998410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944e5c-a6c1-4252-a832-5991df2307b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:57.998987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944e5c-a6c1-4252-a832-5991df2307b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:57.998987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944e5c-a6c1-4252-a832-5991df2307b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.000020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37944e5c-a6c1-4252-a832-5991df2307b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:19:58.000020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37944e5c-a6c1-4252-a832-5991df2307b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.001617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37944e5c-a6c1-4252-a832-5991df2307b1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.003408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:58.019562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1058/2106] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:19:58.020628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17916f-6012-4002-a4c6-e6c4c627aa18 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.036062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17916f-6012-4002-a4c6-e6c4c627aa18 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.040731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e3804-5f1e-4757-b85b-860042bf9e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.041392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e3804-5f1e-4757-b85b-860042bf9e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.041671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e3804-5f1e-4757-b85b-860042bf9e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.041943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e3804-5f1e-4757-b85b-860042bf9e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.042689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e3804-5f1e-4757-b85b-860042bf9e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.044575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e3804-5f1e-4757-b85b-860042bf9e25 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.072795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1049/2107] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:58 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:58.076910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37944e5c-a6c1-4252-a832-5991df2307b1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.086890 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37944e5c-a6c1-4252-a832-5991df2307b1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.148540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e04379-1f2b-49b7-844f-e9f9858ca3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.149253 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04379-1f2b-49b7-844f-e9f9858ca3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.149537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04379-1f2b-49b7-844f-e9f9858ca3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.149813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04379-1f2b-49b7-844f-e9f9858ca3f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.150544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e04379-1f2b-49b7-844f-e9f9858ca3f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.152727 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e04379-1f2b-49b7-844f-e9f9858ca3f1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.173308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1059/2108] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:58 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:58.177422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e3804-5f1e-4757-b85b-860042bf9e25 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.188864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e3804-5f1e-4757-b85b-860042bf9e25 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.194438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bcb82-83b1-4543-861e-c48d3c841542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.195108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bcb82-83b1-4543-861e-c48d3c841542 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.195391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bcb82-83b1-4543-861e-c48d3c841542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.195665 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bcb82-83b1-4543-861e-c48d3c841542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.196398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bcb82-83b1-4543-861e-c48d3c841542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.198045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bcb82-83b1-4543-861e-c48d3c841542 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.209246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1050/2109] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:19:58.213449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e04379-1f2b-49b7-844f-e9f9858ca3f1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.224595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e04379-1f2b-49b7-844f-e9f9858ca3f1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.230876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086649c9-b2e3-4e0c-acb4-4df8e9372a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.231545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086649c9-b2e3-4e0c-acb4-4df8e9372a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.231831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086649c9-b2e3-4e0c-acb4-4df8e9372a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.232109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086649c9-b2e3-4e0c-acb4-4df8e9372a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.232879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086649c9-b2e3-4e0c-acb4-4df8e9372a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.234511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086649c9-b2e3-4e0c-acb4-4df8e9372a98 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.244503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1060/2110] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:58.248897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bcb82-83b1-4543-861e-c48d3c841542 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.259295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bcb82-83b1-4543-861e-c48d3c841542 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.264825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe47f-9421-43ac-b190-c9d7ba1ae92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.265719 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe47f-9421-43ac-b190-c9d7ba1ae92f admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.266000 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe47f-9421-43ac-b190-c9d7ba1ae92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.266274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe47f-9421-43ac-b190-c9d7ba1ae92f admin admin] PATH_INFO: `/v3/projects/9b52dffdce7548489661549e3cc57566/users/390e7959bc2a4cc7ab7eb69e323984bb/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.278630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:58.284882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe47f-9421-43ac-b190-c9d7ba1ae92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b52dffdce7548489661549e3cc57566, user_id=390e7959bc2a4cc7ab7eb69e323984bb, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.289643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe47f-9421-43ac-b190-c9d7ba1ae92f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.309420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1051/2111] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:58 2022] PUT /identity/v3/projects/9b52dffdce7548489661549e3cc57566/users/390e7959bc2a4cc7ab7eb69e323984bb/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:58.319770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb89c8-14c2-4d58-a80f-299ea52f0c54 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.320082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb89c8-14c2-4d58-a80f-299ea52f0c54 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.320361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb89c8-14c2-4d58-a80f-299ea52f0c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.349421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-16bb89c8-14c2-4d58-a80f-299ea52f0c54 None None] MFA Rules not processed for user `390e7959bc2a4cc7ab7eb69e323984bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:58.350649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-16bb89c8-14c2-4d58-a80f-299ea52f0c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:58.421319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1061/2112] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:58.426034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe47f-9421-43ac-b190-c9d7ba1ae92f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.493364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe47f-9421-43ac-b190-c9d7ba1ae92f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.499112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794518-7761-44ac-8362-8374bbee9994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.499785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794518-7761-44ac-8362-8374bbee9994 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.500073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794518-7761-44ac-8362-8374bbee9994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.500348 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794518-7761-44ac-8362-8374bbee9994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.501102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73794518-7761-44ac-8362-8374bbee9994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.503080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73794518-7761-44ac-8362-8374bbee9994 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.532909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1052/2113] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:19:58 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:58.537104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb89c8-14c2-4d58-a80f-299ea52f0c54 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.548651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb89c8-14c2-4d58-a80f-299ea52f0c54 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.613327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f2eb2-ec49-4e63-96ea-03c680578316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.614017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f2eb2-ec49-4e63-96ea-03c680578316 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.614296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f2eb2-ec49-4e63-96ea-03c680578316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.614583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f2eb2-ec49-4e63-96ea-03c680578316 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.615281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f2eb2-ec49-4e63-96ea-03c680578316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.617269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f2eb2-ec49-4e63-96ea-03c680578316 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.626209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:58.640526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1062/2114] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:19:58 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:19:58.644941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794518-7761-44ac-8362-8374bbee9994 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.656211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794518-7761-44ac-8362-8374bbee9994 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.661394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ccc7-184d-4460-bacf-c28c3c845b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.662076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ccc7-184d-4460-bacf-c28c3c845b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.662377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ccc7-184d-4460-bacf-c28c3c845b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.662649 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ccc7-184d-4460-bacf-c28c3c845b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.663386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ccc7-184d-4460-bacf-c28c3c845b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.665041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ccc7-184d-4460-bacf-c28c3c845b6c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.677246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1053/2115] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:58.681693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f2eb2-ec49-4e63-96ea-03c680578316 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.692471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f2eb2-ec49-4e63-96ea-03c680578316 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.698202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d006aa-43e4-4805-baab-378e6653e07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.699231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d006aa-43e4-4805-baab-378e6653e07c admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.699506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d006aa-43e4-4805-baab-378e6653e07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.699768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d006aa-43e4-4805-baab-378e6653e07c admin admin] PATH_INFO: `/v3/projects/3dd6e3b4579441e099f170a969c9c8f2/users/d729f35225d44ddc9a031cb3dc89c0e8/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.715990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d006aa-43e4-4805-baab-378e6653e07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd6e3b4579441e099f170a969c9c8f2, user_id=d729f35225d44ddc9a031cb3dc89c0e8, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.718839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d006aa-43e4-4805-baab-378e6653e07c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.733176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1063/2116] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:58 2022] PUT /identity/v3/projects/3dd6e3b4579441e099f170a969c9c8f2/users/d729f35225d44ddc9a031cb3dc89c0e8/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:58.737904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ccc7-184d-4460-bacf-c28c3c845b6c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.749515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ccc7-184d-4460-bacf-c28c3c845b6c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.814496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f18df2-ef11-41ea-8542-566e3fb5f6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.815188 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f18df2-ef11-41ea-8542-566e3fb5f6fb admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.815478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f18df2-ef11-41ea-8542-566e3fb5f6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.815751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f18df2-ef11-41ea-8542-566e3fb5f6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.816492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f18df2-ef11-41ea-8542-566e3fb5f6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.818149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f18df2-ef11-41ea-8542-566e3fb5f6fb admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.830086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1054/2117] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:19:58.834201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d006aa-43e4-4805-baab-378e6653e07c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:58.845314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d006aa-43e4-4805-baab-378e6653e07c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:58.850390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001e9a4-2c8d-46cb-9df6-6f49ca909c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:58.851277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e9a4-2c8d-46cb-9df6-6f49ca909c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.851558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e9a4-2c8d-46cb-9df6-6f49ca909c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.851829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e9a4-2c8d-46cb-9df6-6f49ca909c78 admin admin] PATH_INFO: `/v3/projects/3dd6e3b4579441e099f170a969c9c8f2/users/d729f35225d44ddc9a031cb3dc89c0e8/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.853847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001e9a4-2c8d-46cb-9df6-6f49ca909c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd6e3b4579441e099f170a969c9c8f2, user_id=d729f35225d44ddc9a031cb3dc89c0e8, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:58.857263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001e9a4-2c8d-46cb-9df6-6f49ca909c78 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:58.867929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1064/2118] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:19:58 2022] PUT /identity/v3/projects/3dd6e3b4579441e099f170a969c9c8f2/users/d729f35225d44ddc9a031cb3dc89c0e8/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:58.879566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5071e8-1115-41f9-b88e-8b5acf989e9b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:58.879854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5071e8-1115-41f9-b88e-8b5acf989e9b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:58.880129 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5071e8-1115-41f9-b88e-8b5acf989e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:58.908995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1c5071e8-1115-41f9-b88e-8b5acf989e9b None None] MFA Rules not processed for user `d729f35225d44ddc9a031cb3dc89c0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:58.910208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1c5071e8-1115-41f9-b88e-8b5acf989e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:58.964771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:58.996039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1055/2119] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:19:59.008889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001e9a4-2c8d-46cb-9df6-6f49ca909c78 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:59.011496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6001e9a4-2c8d-46cb-9df6-6f49ca909c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:59.086660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001e9a4-2c8d-46cb-9df6-6f49ca909c78 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:59.090985 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a748-f7fe-464b-9ef9-b5c564f421b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:59.091643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a748-f7fe-464b-9ef9-b5c564f421b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:59.091925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a748-f7fe-464b-9ef9-b5c564f421b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:59.092198 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a748-f7fe-464b-9ef9-b5c564f421b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:59.098590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5071e8-1115-41f9-b88e-8b5acf989e9b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:59.100528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1c5071e8-1115-41f9-b88e-8b5acf989e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:59.105362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592a748-f7fe-464b-9ef9-b5c564f421b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:59.106826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592a748-f7fe-464b-9ef9-b5c564f421b4 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:59.118444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1065/2120] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:59.208836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5071e8-1115-41f9-b88e-8b5acf989e9b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:59.213650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:59.214701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:59.215057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:59.215256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] PATH_INFO: `/v3/users/245dfa63a0e143889b43c3fa16530035` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:59.218254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=245dfa63a0e143889b43c3fa16530035)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:59.220597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:59.236811 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a748-f7fe-464b-9ef9-b5c564f421b4 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:59.246002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a748-f7fe-464b-9ef9-b5c564f421b4 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:59.249931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bb36c-a99c-4fed-a82c-65390db2199a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:59.250594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bb36c-a99c-4fed-a82c-65390db2199a service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:59.250887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bb36c-a99c-4fed-a82c-65390db2199a service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:59.251187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bb36c-a99c-4fed-a82c-65390db2199a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:59.277446 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245dfa63a0e143889b43c3fa16530035'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:59.278193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245dfa63a0e143889b43c3fa16530035'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:59.286636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245dfa63a0e143889b43c3fa16530035'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:59.295567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245dfa63a0e143889b43c3fa16530035'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:59.296467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-46ee8f9d-6bad-4b1e-aa40-f8e55fa65a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245dfa63a0e143889b43c3fa16530035'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:59.315069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1056/2121] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:19:59 2022] DELETE /identity/v3/users/245dfa63a0e143889b43c3fa16530035 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:19:59.319697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c57c6-8f76-429a-8a46-5bd124de1567 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:59.319987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c57c6-8f76-429a-8a46-5bd124de1567 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:59.320294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c57c6-8f76-429a-8a46-5bd124de1567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:59.322488 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bb36c-a99c-4fed-a82c-65390db2199a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:59.324035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bb36c-a99c-4fed-a82c-65390db2199a service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:59.333802 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1066/2122] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:19:59.340244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8a6c57c6-8f76-429a-8a46-5bd124de1567 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:19:59.343648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8a6c57c6-8f76-429a-8a46-5bd124de1567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:59.429065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1057/2123] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:19:59.435734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bb36c-a99c-4fed-a82c-65390db2199a service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:59.437168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3d1bb36c-a99c-4fed-a82c-65390db2199a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:59.501354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bb36c-a99c-4fed-a82c-65390db2199a service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:59.509637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:59.564477 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199b756-ed5a-4cb4-802d-1164047145a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:59.565217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199b756-ed5a-4cb4-802d-1164047145a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:59.565466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199b756-ed5a-4cb4-802d-1164047145a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:59.565767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199b756-ed5a-4cb4-802d-1164047145a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:59.576283 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199b756-ed5a-4cb4-802d-1164047145a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:59.577821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199b756-ed5a-4cb4-802d-1164047145a0 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:59.587735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1067/2124] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:19:59.871557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c57c6-8f76-429a-8a46-5bd124de1567 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:19:59.872569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8a6c57c6-8f76-429a-8a46-5bd124de1567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:19:59.881304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:19:59.885460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c57c6-8f76-429a-8a46-5bd124de1567 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:19:59.893042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:19:59.894176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:59.894466 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:59.895457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] PATH_INFO: `/v3/projects/e426b79bc33a4efda9cd0d492ed51162` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:19:59.897498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e426b79bc33a4efda9cd0d492ed51162)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:19:59.899618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:19:59.954432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e426b79bc33a4efda9cd0d492ed51162', 'request_id': 'req-45d67c71-61eb-41df-84a9-fbce374c1d25'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:59.962403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e426b79bc33a4efda9cd0d492ed51162', 'request_id': 'req-45d67c71-61eb-41df-84a9-fbce374c1d25'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:59.969003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e426b79bc33a4efda9cd0d492ed51162', 'request_id': 'req-45d67c71-61eb-41df-84a9-fbce374c1d25'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:59.979836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] The token cache is being invalidate because project e426b79bc33a4efda9cd0d492ed51162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:19:59.980127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:59.980866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-45d67c71-61eb-41df-84a9-fbce374c1d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:19:59.982531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1058/2125] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:19:59 2022] DELETE /identity/v3/projects/e426b79bc33a4efda9cd0d492ed51162 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:19:59.987487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04236-29b9-436f-904f-4b8079e169a4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:19:59.987877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04236-29b9-436f-904f-4b8079e169a4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:19:59.988162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04236-29b9-436f-904f-4b8079e169a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:00.006758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-12a04236-29b9-436f-904f-4b8079e169a4 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:00.007978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-12a04236-29b9-436f-904f-4b8079e169a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:00.081007 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1068/2126] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:00.090011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f87b-3bde-4146-a569-88ebd2f8eec7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:00.090310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f87b-3bde-4146-a569-88ebd2f8eec7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:00.090585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f87b-3bde-4146-a569-88ebd2f8eec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:00.109750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f036f87b-3bde-4146-a569-88ebd2f8eec7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:00.110971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f036f87b-3bde-4146-a569-88ebd2f8eec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:00.119024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1059/2127] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:00.123440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04236-29b9-436f-904f-4b8079e169a4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:00.133281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04236-29b9-436f-904f-4b8079e169a4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:00.138472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583c7ea-89c8-4c4d-a4e0-1891f3975934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:00.139126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583c7ea-89c8-4c4d-a4e0-1891f3975934 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:00.139406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583c7ea-89c8-4c4d-a4e0-1891f3975934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:00.139676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583c7ea-89c8-4c4d-a4e0-1891f3975934 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:00.140409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583c7ea-89c8-4c4d-a4e0-1891f3975934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:20:00.140739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583c7ea-89c8-4c4d-a4e0-1891f3975934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:00.142361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583c7ea-89c8-4c4d-a4e0-1891f3975934 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:00.155541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1069/2128] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:20:00.159941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036f87b-3bde-4146-a569-88ebd2f8eec7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:00.169623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036f87b-3bde-4146-a569-88ebd2f8eec7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:00.174674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82d15-875e-454a-bcba-8962c942f2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:00.175334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82d15-875e-454a-bcba-8962c942f2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:00.175620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82d15-875e-454a-bcba-8962c942f2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:00.175899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82d15-875e-454a-bcba-8962c942f2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:00.176600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82d15-875e-454a-bcba-8962c942f2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:00.178544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82d15-875e-454a-bcba-8962c942f2e4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:00.208212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1060/2129] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:20:00 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:00.213466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583c7ea-89c8-4c4d-a4e0-1891f3975934 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:00.225446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583c7ea-89c8-4c4d-a4e0-1891f3975934 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:00.293117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280169ac-0bf5-4fd3-943b-0baf8a84cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:00.293786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280169ac-0bf5-4fd3-943b-0baf8a84cd12 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:00.294063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280169ac-0bf5-4fd3-943b-0baf8a84cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:00.294341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280169ac-0bf5-4fd3-943b-0baf8a84cd12 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:00.295040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280169ac-0bf5-4fd3-943b-0baf8a84cd12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:00.296983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280169ac-0bf5-4fd3-943b-0baf8a84cd12 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:00.324750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1070/2130] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:20:00 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:00.326640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82d15-875e-454a-bcba-8962c942f2e4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:00.339504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82d15-875e-454a-bcba-8962c942f2e4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:00.346692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586477b5-feef-4d3d-99f4-426485a7725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:00.347815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586477b5-feef-4d3d-99f4-426485a7725a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:00.348241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586477b5-feef-4d3d-99f4-426485a7725a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:00.348728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586477b5-feef-4d3d-99f4-426485a7725a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:00.349861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586477b5-feef-4d3d-99f4-426485a7725a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:00.351686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586477b5-feef-4d3d-99f4-426485a7725a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:00.366997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1061/2131] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:00.370900 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280169ac-0bf5-4fd3-943b-0baf8a84cd12 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:00.383193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280169ac-0bf5-4fd3-943b-0baf8a84cd12 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:00.387958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157c981-11b7-4bdc-8f10-de318217d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:00.388602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157c981-11b7-4bdc-8f10-de318217d191 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:00.388946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157c981-11b7-4bdc-8f10-de318217d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:00.389228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157c981-11b7-4bdc-8f10-de318217d191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:00.389946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157c981-11b7-4bdc-8f10-de318217d191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:00.391511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157c981-11b7-4bdc-8f10-de318217d191 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:00.402230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1071/2132] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:00.406924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586477b5-feef-4d3d-99f4-426485a7725a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:00.416929 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586477b5-feef-4d3d-99f4-426485a7725a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:00.421921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1816a-ad82-43d2-874b-99973b5a455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:00.422833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1816a-ad82-43d2-874b-99973b5a455d admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:00.423115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1816a-ad82-43d2-874b-99973b5a455d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:00.423391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1816a-ad82-43d2-874b-99973b5a455d admin admin] PATH_INFO: `/v3/projects/0989411f98394c03824ad7f8185e29ad/users/dd68e291b36347d29b568e3a24f53242/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:00.441963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1816a-ad82-43d2-874b-99973b5a455d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0989411f98394c03824ad7f8185e29ad, user_id=dd68e291b36347d29b568e3a24f53242, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:00.445303 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1816a-ad82-43d2-874b-99973b5a455d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:00.460774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1062/2133] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:00 2022] PUT /identity/v3/projects/0989411f98394c03824ad7f8185e29ad/users/dd68e291b36347d29b568e3a24f53242/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:00.465974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc719b5-4e66-4f7d-a173-df6b56191e65 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:00.466270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc719b5-4e66-4f7d-a173-df6b56191e65 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:00.466547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc719b5-4e66-4f7d-a173-df6b56191e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:00.488142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-dfc719b5-4e66-4f7d-a173-df6b56191e65 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:00.490233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-dfc719b5-4e66-4f7d-a173-df6b56191e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:00.503827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:00.558826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1072/2134] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:20:00.568804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1816a-ad82-43d2-874b-99973b5a455d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:00.570626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a4a1816a-ad82-43d2-874b-99973b5a455d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:00.631478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1816a-ad82-43d2-874b-99973b5a455d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:00.635403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95c486-0ad3-4132-852f-15d9870d5f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:00.636103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95c486-0ad3-4132-852f-15d9870d5f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:00.636408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95c486-0ad3-4132-852f-15d9870d5f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:00.636688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95c486-0ad3-4132-852f-15d9870d5f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:00.646269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95c486-0ad3-4132-852f-15d9870d5f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:00.647705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95c486-0ad3-4132-852f-15d9870d5f9d service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:00.657218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1063/2135] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:01.340576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb7c87-1601-4a78-9c8c-5bce10bd1cbe None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:01.341116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb7c87-1601-4a78-9c8c-5bce10bd1cbe None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:01.341207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb7c87-1601-4a78-9c8c-5bce10bd1cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:01.374814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3fdb7c87-1601-4a78-9c8c-5bce10bd1cbe None None] MFA Rules not processed for user `dd68e291b36347d29b568e3a24f53242`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:01.376064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3fdb7c87-1601-4a78-9c8c-5bce10bd1cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:01.491692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1073/2136] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:01.506724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95c486-0ad3-4132-852f-15d9870d5f9d service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:01.508718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cd95c486-0ad3-4132-852f-15d9870d5f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:01.548599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:01.589454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95c486-0ad3-4132-852f-15d9870d5f9d service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:01.594141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59608b3c-b966-41df-b28b-914f9a03fdd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:01.595147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59608b3c-b966-41df-b28b-914f9a03fdd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:01.595147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59608b3c-b966-41df-b28b-914f9a03fdd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:01.595325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59608b3c-b966-41df-b28b-914f9a03fdd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:01.604913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59608b3c-b966-41df-b28b-914f9a03fdd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:01.606512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59608b3c-b966-41df-b28b-914f9a03fdd0 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:01.616172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1064/2137] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:01.985737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb7c87-1601-4a78-9c8c-5bce10bd1cbe None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:01.988099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3fdb7c87-1601-4a78-9c8c-5bce10bd1cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:02.003475 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb7c87-1601-4a78-9c8c-5bce10bd1cbe None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:02.008210 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:02.009119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:02.009552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:02.009815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] PATH_INFO: `/v3/users/390e7959bc2a4cc7ab7eb69e323984bb` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:02.011499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=390e7959bc2a4cc7ab7eb69e323984bb)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:02.013908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:02.065509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390e7959bc2a4cc7ab7eb69e323984bb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.073649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390e7959bc2a4cc7ab7eb69e323984bb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.074459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390e7959bc2a4cc7ab7eb69e323984bb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.081431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390e7959bc2a4cc7ab7eb69e323984bb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.082065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390e7959bc2a4cc7ab7eb69e323984bb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.099264 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1074/2138] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:20:01 2022] DELETE /identity/v3/users/390e7959bc2a4cc7ab7eb69e323984bb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:02.104855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b001af-5ff1-432e-a91f-28c2febd90c7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:02.105518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b001af-5ff1-432e-a91f-28c2febd90c7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:02.106025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b001af-5ff1-432e-a91f-28c2febd90c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:02.129190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d1b001af-5ff1-432e-a91f-28c2febd90c7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:02.130403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d1b001af-5ff1-432e-a91f-28c2febd90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:02.197485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1065/2139] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:02.210824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:02.212552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:02.241661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:02.277565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6da219-7045-47b1-b984-7fec0da984ae admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:02.281693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb1d6f-dd2b-4512-a32b-cccb60a3eb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:02.282358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb1d6f-dd2b-4512-a32b-cccb60a3eb3a service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:02.282646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb1d6f-dd2b-4512-a32b-cccb60a3eb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:02.282925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb1d6f-dd2b-4512-a32b-cccb60a3eb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:02.292737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb1d6f-dd2b-4512-a32b-cccb60a3eb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:02.294203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb1d6f-dd2b-4512-a32b-cccb60a3eb3a service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:02.303954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1075/2140] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:02.589537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b001af-5ff1-432e-a91f-28c2febd90c7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:02.591340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d1b001af-5ff1-432e-a91f-28c2febd90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:02.608121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b001af-5ff1-432e-a91f-28c2febd90c7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:02.623434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:02.624525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:02.625016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:02.625441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] PATH_INFO: `/v3/projects/9b52dffdce7548489661549e3cc57566` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:02.627090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b52dffdce7548489661549e3cc57566)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:02.629069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:02.685590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b52dffdce7548489661549e3cc57566', 'request_id': 'req-18ce087a-7473-4cb7-bf6a-22f6d12a4631'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.694769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b52dffdce7548489661549e3cc57566', 'request_id': 'req-18ce087a-7473-4cb7-bf6a-22f6d12a4631'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.701514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b52dffdce7548489661549e3cc57566', 'request_id': 'req-18ce087a-7473-4cb7-bf6a-22f6d12a4631'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.711942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] The token cache is being invalidate because project 9b52dffdce7548489661549e3cc57566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:20:02.712229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.712919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-18ce087a-7473-4cb7-bf6a-22f6d12a4631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.714719 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1066/2141] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:20:02 2022] DELETE /identity/v3/projects/9b52dffdce7548489661549e3cc57566 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:02.719344 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb1d6f-dd2b-4512-a32b-cccb60a3eb3a service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:02.729511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb1d6f-dd2b-4512-a32b-cccb60a3eb3a service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:02.789963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:02.790991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:02.791663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:02.791663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] PATH_INFO: `/v3/users/d729f35225d44ddc9a031cb3dc89c0e8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:02.792963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d729f35225d44ddc9a031cb3dc89c0e8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:02.794902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:02.844226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd729f35225d44ddc9a031cb3dc89c0e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.855194 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd729f35225d44ddc9a031cb3dc89c0e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.855921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd729f35225d44ddc9a031cb3dc89c0e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.863303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd729f35225d44ddc9a031cb3dc89c0e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.864010 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd729f35225d44ddc9a031cb3dc89c0e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:02.883279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1076/2142] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:20:02 2022] DELETE /identity/v3/users/d729f35225d44ddc9a031cb3dc89c0e8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:02.974905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd63a9a-2b5a-4a27-80c5-79bb9081b62d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:02.975271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd63a9a-2b5a-4a27-80c5-79bb9081b62d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:02.975612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd63a9a-2b5a-4a27-80c5-79bb9081b62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:02.998915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1dd63a9a-2b5a-4a27-80c5-79bb9081b62d None None] MFA Rules not processed for user `dd68e291b36347d29b568e3a24f53242`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:03.000145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1dd63a9a-2b5a-4a27-80c5-79bb9081b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:03.069495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:03.081536 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1067/2143] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:03.210485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:03.212027 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:03.265114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:03.295776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363ce12-53b2-48f5-b799-b94cb8ae0814 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:03.303367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:03.304353 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:03.304759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:03.305134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] PATH_INFO: `/v3/projects/3dd6e3b4579441e099f170a969c9c8f2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:03.306392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd6e3b4579441e099f170a969c9c8f2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:03.308725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:03.359049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd6e3b4579441e099f170a969c9c8f2', 'request_id': 'req-edf5368c-5623-43ef-9fc7-415f3c5c052d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:03.370737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd6e3b4579441e099f170a969c9c8f2', 'request_id': 'req-edf5368c-5623-43ef-9fc7-415f3c5c052d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:03.386415 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd6e3b4579441e099f170a969c9c8f2', 'request_id': 'req-edf5368c-5623-43ef-9fc7-415f3c5c052d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:03.398914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] The token cache is being invalidate because project 3dd6e3b4579441e099f170a969c9c8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:20:03.399399 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:03.399944 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-edf5368c-5623-43ef-9fc7-415f3c5c052d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:03.402854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1077/2144] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:20:03 2022] DELETE /identity/v3/projects/3dd6e3b4579441e099f170a969c9c8f2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:20:03.406919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89ee3-35e5-4cf4-9248-f19104039ceb None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:03.407299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89ee3-35e5-4cf4-9248-f19104039ceb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:03.407653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89ee3-35e5-4cf4-9248-f19104039ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:03.426371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2fe89ee3-35e5-4cf4-9248-f19104039ceb None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:03.427751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2fe89ee3-35e5-4cf4-9248-f19104039ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:03.488698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1068/2145] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:03.496606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a8f64-d9db-466b-b165-a1b0984b93db None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:03.496927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a8f64-d9db-466b-b165-a1b0984b93db None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:03.497210 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a8f64-d9db-466b-b165-a1b0984b93db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:03.524614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c88a8f64-d9db-466b-b165-a1b0984b93db None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:03.525911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c88a8f64-d9db-466b-b165-a1b0984b93db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:03.534968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1078/2146] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:03.539404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89ee3-35e5-4cf4-9248-f19104039ceb None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:03.549832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89ee3-35e5-4cf4-9248-f19104039ceb None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:03.555236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf4c5-8b9e-4d2f-b3ee-370deb367e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:03.555871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf4c5-8b9e-4d2f-b3ee-370deb367e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:03.556192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf4c5-8b9e-4d2f-b3ee-370deb367e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:03.556464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf4c5-8b9e-4d2f-b3ee-370deb367e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:03.557257 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daf4c5-8b9e-4d2f-b3ee-370deb367e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:20:03.557534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daf4c5-8b9e-4d2f-b3ee-370deb367e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:03.559387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daf4c5-8b9e-4d2f-b3ee-370deb367e2d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:03.571644 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1069/2147] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:20:03.576274 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a8f64-d9db-466b-b165-a1b0984b93db None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:03.586038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a8f64-d9db-466b-b165-a1b0984b93db None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:03.594297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95976e9b-fa8a-45b6-97e8-ba5ac8b18602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:03.595121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976e9b-fa8a-45b6-97e8-ba5ac8b18602 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:03.595722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976e9b-fa8a-45b6-97e8-ba5ac8b18602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:03.595722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976e9b-fa8a-45b6-97e8-ba5ac8b18602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:03.596580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95976e9b-fa8a-45b6-97e8-ba5ac8b18602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:03.598766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95976e9b-fa8a-45b6-97e8-ba5ac8b18602 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:03.632097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1079/2148] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:20:03 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:03.633255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf4c5-8b9e-4d2f-b3ee-370deb367e2d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:03.644607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf4c5-8b9e-4d2f-b3ee-370deb367e2d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:03.711155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce1195-f898-4b92-a478-734223bd1f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:03.711836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1195-f898-4b92-a478-734223bd1f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:03.712117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1195-f898-4b92-a478-734223bd1f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:03.712390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1195-f898-4b92-a478-734223bd1f4a admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:03.713177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce1195-f898-4b92-a478-734223bd1f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:03.715203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce1195-f898-4b92-a478-734223bd1f4a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:03.735125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1070/2149] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:20:03 2022] POST /identity/v3/users => generated 304 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:20:03.739599 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95976e9b-fa8a-45b6-97e8-ba5ac8b18602 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:03.750822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95976e9b-fa8a-45b6-97e8-ba5ac8b18602 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:03.756739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a286e2-33ef-4377-b307-ea3d73700d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:03.757522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a286e2-33ef-4377-b307-ea3d73700d9f admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:03.757807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a286e2-33ef-4377-b307-ea3d73700d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:03.758082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a286e2-33ef-4377-b307-ea3d73700d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:03.758938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a286e2-33ef-4377-b307-ea3d73700d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:03.760524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a286e2-33ef-4377-b307-ea3d73700d9f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:03.773444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1080/2150] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:03.777495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce1195-f898-4b92-a478-734223bd1f4a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:03.797198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce1195-f898-4b92-a478-734223bd1f4a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:03.803547 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3d6cc-42aa-421d-8fad-cb9205667406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:03.805986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3d6cc-42aa-421d-8fad-cb9205667406 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:03.806285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3d6cc-42aa-421d-8fad-cb9205667406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:03.806646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3d6cc-42aa-421d-8fad-cb9205667406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:03.807467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3d6cc-42aa-421d-8fad-cb9205667406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:03.815636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3d6cc-42aa-421d-8fad-cb9205667406 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:03.832100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1071/2151] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:20:03.837048 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a286e2-33ef-4377-b307-ea3d73700d9f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:03.852316 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a286e2-33ef-4377-b307-ea3d73700d9f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:03.863668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2ff86-054a-40d8-b587-aa830c36204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:03.864582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ff86-054a-40d8-b587-aa830c36204d admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:03.865047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ff86-054a-40d8-b587-aa830c36204d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:03.865331 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ff86-054a-40d8-b587-aa830c36204d admin admin] PATH_INFO: `/v3/projects/3892bdf10b6645cb8ffb41a70530f87f/users/7c94430c414f4d8eb71063c7b567efa2/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:03.884266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2ff86-054a-40d8-b587-aa830c36204d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3892bdf10b6645cb8ffb41a70530f87f, user_id=7c94430c414f4d8eb71063c7b567efa2, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:03.887413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2ff86-054a-40d8-b587-aa830c36204d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:03.906005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1081/2152] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:03 2022] PUT /identity/v3/projects/3892bdf10b6645cb8ffb41a70530f87f/users/7c94430c414f4d8eb71063c7b567efa2/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:03.915870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14abe9-7922-4623-81e5-5e6296327d41 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:03.916183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14abe9-7922-4623-81e5-5e6296327d41 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:03.916462 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14abe9-7922-4623-81e5-5e6296327d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:03.951152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ea14abe9-7922-4623-81e5-5e6296327d41 None None] MFA Rules not processed for user `7c94430c414f4d8eb71063c7b567efa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:03.952377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ea14abe9-7922-4623-81e5-5e6296327d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:04.015448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:04.037233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1072/2153] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:04.041770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2ff86-054a-40d8-b587-aa830c36204d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:04.117151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2ff86-054a-40d8-b587-aa830c36204d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:04.122424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f0624-27ad-4be8-9bab-c9010846ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:04.123095 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f0624-27ad-4be8-9bab-c9010846ceea admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:04.123375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f0624-27ad-4be8-9bab-c9010846ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:04.124076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f0624-27ad-4be8-9bab-c9010846ceea admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:04.124341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f0624-27ad-4be8-9bab-c9010846ceea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:04.126349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f0624-27ad-4be8-9bab-c9010846ceea admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:04.142892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:04.161158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1082/2154] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:20:04 2022] POST /identity/v3/projects => generated 409 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:04.165263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14abe9-7922-4623-81e5-5e6296327d41 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:04.177340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14abe9-7922-4623-81e5-5e6296327d41 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:04.240738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110fcf3-8ffe-42f4-98e0-5f31654eae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:04.241715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fcf3-8ffe-42f4-98e0-5f31654eae5b admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:04.242125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fcf3-8ffe-42f4-98e0-5f31654eae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:04.242452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fcf3-8ffe-42f4-98e0-5f31654eae5b admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:04.244680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110fcf3-8ffe-42f4-98e0-5f31654eae5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:04.246779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110fcf3-8ffe-42f4-98e0-5f31654eae5b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:04.271532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1073/2155] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:20:04 2022] POST /identity/v3/users => generated 311 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:04.272927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f0624-27ad-4be8-9bab-c9010846ceea admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:04.284482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f0624-27ad-4be8-9bab-c9010846ceea admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:04.289594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67795e82-ff6f-47b1-9913-0063329f9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:04.290301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67795e82-ff6f-47b1-9913-0063329f9a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:04.290587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67795e82-ff6f-47b1-9913-0063329f9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:04.290889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67795e82-ff6f-47b1-9913-0063329f9a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:04.291624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67795e82-ff6f-47b1-9913-0063329f9a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:04.293301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67795e82-ff6f-47b1-9913-0063329f9a92 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:04.305063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1083/2156] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:04.310180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110fcf3-8ffe-42f4-98e0-5f31654eae5b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:04.321633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110fcf3-8ffe-42f4-98e0-5f31654eae5b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:04.327637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0013d3e-c0cf-4f45-b30b-d9091e7cf6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:04.328568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0013d3e-c0cf-4f45-b30b-d9091e7cf6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:04.328948 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0013d3e-c0cf-4f45-b30b-d9091e7cf6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:04.329197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0013d3e-c0cf-4f45-b30b-d9091e7cf6b5 admin admin] PATH_INFO: `/v3/projects/4f74453d20884f3492023c6cdbe52687/users/7057807ced4e4a5e9bee8e7fa97721f5/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:04.345837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0013d3e-c0cf-4f45-b30b-d9091e7cf6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f74453d20884f3492023c6cdbe52687, user_id=7057807ced4e4a5e9bee8e7fa97721f5, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:04.348577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0013d3e-c0cf-4f45-b30b-d9091e7cf6b5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:04.363393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1074/2157] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:04 2022] PUT /identity/v3/projects/4f74453d20884f3492023c6cdbe52687/users/7057807ced4e4a5e9bee8e7fa97721f5/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:04.367649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67795e82-ff6f-47b1-9913-0063329f9a92 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:04.384157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67795e82-ff6f-47b1-9913-0063329f9a92 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:04.446294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846b8f-d0ae-49eb-98ae-181e286eefef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:04.447078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846b8f-d0ae-49eb-98ae-181e286eefef admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:04.447998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846b8f-d0ae-49eb-98ae-181e286eefef admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:04.448276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846b8f-d0ae-49eb-98ae-181e286eefef admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:04.449344 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78846b8f-d0ae-49eb-98ae-181e286eefef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:04.450879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78846b8f-d0ae-49eb-98ae-181e286eefef admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:04.472796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1084/2158] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:04.473646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0013d3e-c0cf-4f45-b30b-d9091e7cf6b5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:04.489466 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0013d3e-c0cf-4f45-b30b-d9091e7cf6b5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:04.495213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9ce19-cdc3-40f4-9798-cabdc6b29e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:04.496921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ce19-cdc3-40f4-9798-cabdc6b29e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:04.497207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ce19-cdc3-40f4-9798-cabdc6b29e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:04.497504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ce19-cdc3-40f4-9798-cabdc6b29e62 admin admin] PATH_INFO: `/v3/projects/4f74453d20884f3492023c6cdbe52687/users/7057807ced4e4a5e9bee8e7fa97721f5/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:04.499978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9ce19-cdc3-40f4-9798-cabdc6b29e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f74453d20884f3492023c6cdbe52687, user_id=7057807ced4e4a5e9bee8e7fa97721f5, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:04.502976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9ce19-cdc3-40f4-9798-cabdc6b29e62 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:04.514609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1075/2159] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:04 2022] PUT /identity/v3/projects/4f74453d20884f3492023c6cdbe52687/users/7057807ced4e4a5e9bee8e7fa97721f5/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:20:04.526355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e32b4-08b7-4d90-b7bd-7a2538ca4939 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:04.526651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e32b4-08b7-4d90-b7bd-7a2538ca4939 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:04.526968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e32b4-08b7-4d90-b7bd-7a2538ca4939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:04.554512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-245e32b4-08b7-4d90-b7bd-7a2538ca4939 None None] MFA Rules not processed for user `7057807ced4e4a5e9bee8e7fa97721f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:04.555748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-245e32b4-08b7-4d90-b7bd-7a2538ca4939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:04.625151 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1085/2160] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:04 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:04.636686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9ce19-cdc3-40f4-9798-cabdc6b29e62 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:04.638633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-26f9ce19-cdc3-40f4-9798-cabdc6b29e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:04.699141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9ce19-cdc3-40f4-9798-cabdc6b29e62 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:04.703049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab345be-9999-4a53-bbed-a37761b54678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:04.704059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab345be-9999-4a53-bbed-a37761b54678 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:04.704324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab345be-9999-4a53-bbed-a37761b54678 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:04.704621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab345be-9999-4a53-bbed-a37761b54678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:04.714800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab345be-9999-4a53-bbed-a37761b54678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:04.716253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab345be-9999-4a53-bbed-a37761b54678 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:04.726448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1076/2161] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:04 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:04.882123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e32b4-08b7-4d90-b7bd-7a2538ca4939 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:04.893244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e32b4-08b7-4d90-b7bd-7a2538ca4939 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:04.897297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798931-4ab5-4fcf-a6fc-800cf01d931c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:04.897866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798931-4ab5-4fcf-a6fc-800cf01d931c service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:04.898153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798931-4ab5-4fcf-a6fc-800cf01d931c service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:04.898453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798931-4ab5-4fcf-a6fc-800cf01d931c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:04.979169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5798931-4ab5-4fcf-a6fc-800cf01d931c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:04.980995 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5798931-4ab5-4fcf-a6fc-800cf01d931c service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:04.991223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1086/2162] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:04 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:10.394464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab345be-9999-4a53-bbed-a37761b54678 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:10.446827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:10.462459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab345be-9999-4a53-bbed-a37761b54678 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:10.467282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:10.468181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:10.468468 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:10.468782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] PATH_INFO: `/v3/users/7c94430c414f4d8eb71063c7b567efa2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:10.470002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c94430c414f4d8eb71063c7b567efa2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:10.471950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:10.533145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c94430c414f4d8eb71063c7b567efa2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:10.534179 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c94430c414f4d8eb71063c7b567efa2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:10.544962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c94430c414f4d8eb71063c7b567efa2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:10.555581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c94430c414f4d8eb71063c7b567efa2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:10.556314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c94430c414f4d8eb71063c7b567efa2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:10.574463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1077/2163] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:20:10 2022] DELETE /identity/v3/users/7c94430c414f4d8eb71063c7b567efa2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:10.579004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed96aa2-fb8e-451c-a531-31268e40c441 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:10.579473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed96aa2-fb8e-451c-a531-31268e40c441 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:10.579564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed96aa2-fb8e-451c-a531-31268e40c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:10.586382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:10.598425 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6ed96aa2-fb8e-451c-a531-31268e40c441 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:10.599647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6ed96aa2-fb8e-451c-a531-31268e40c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:10.677091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1087/2164] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:10.689949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:10.692036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:10.789227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa6af7-5c39-4ddc-ac12-a56c3d5ed1ba admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:10.794894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b14889-fb1e-4796-8ca4-0914b8f9dc3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:10.795778 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b14889-fb1e-4796-8ca4-0914b8f9dc3f service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:10.796151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b14889-fb1e-4796-8ca4-0914b8f9dc3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:10.796504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b14889-fb1e-4796-8ca4-0914b8f9dc3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:10.808004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b14889-fb1e-4796-8ca4-0914b8f9dc3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:10.809718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b14889-fb1e-4796-8ca4-0914b8f9dc3f service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:10.821473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1078/2165] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:20:11.124984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed96aa2-fb8e-451c-a531-31268e40c441 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:11.127414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6ed96aa2-fb8e-451c-a531-31268e40c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:11.141319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed96aa2-fb8e-451c-a531-31268e40c441 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:11.147281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:11.148285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:11.148552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:11.148925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] PATH_INFO: `/v3/projects/3892bdf10b6645cb8ffb41a70530f87f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:11.150199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3892bdf10b6645cb8ffb41a70530f87f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:11.152773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:11.202072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3892bdf10b6645cb8ffb41a70530f87f', 'request_id': 'req-5f01b2b7-0232-48cf-8cba-688082696f54'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.209793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3892bdf10b6645cb8ffb41a70530f87f', 'request_id': 'req-5f01b2b7-0232-48cf-8cba-688082696f54'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.220382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3892bdf10b6645cb8ffb41a70530f87f', 'request_id': 'req-5f01b2b7-0232-48cf-8cba-688082696f54'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.233961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] The token cache is being invalidate because project 3892bdf10b6645cb8ffb41a70530f87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:20:11.234178 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.234864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.236469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1088/2166] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:20:11 2022] DELETE /identity/v3/projects/3892bdf10b6645cb8ffb41a70530f87f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:11.240644 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b14889-fb1e-4796-8ca4-0914b8f9dc3f service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:11.251399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b14889-fb1e-4796-8ca4-0914b8f9dc3f service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:11.317207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:11.318098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:11.318382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:11.318657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] PATH_INFO: `/v3/users/7057807ced4e4a5e9bee8e7fa97721f5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:11.319882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7057807ced4e4a5e9bee8e7fa97721f5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:11.321880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:11.334304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:11.370311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7057807ced4e4a5e9bee8e7fa97721f5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.371098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7057807ced4e4a5e9bee8e7fa97721f5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.381021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7057807ced4e4a5e9bee8e7fa97721f5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.388581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7057807ced4e4a5e9bee8e7fa97721f5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.389272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d64318bd-7aba-43c1-95a6-77ff3accc123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7057807ced4e4a5e9bee8e7fa97721f5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.407021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1079/2167] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:20:11 2022] DELETE /identity/v3/users/7057807ced4e4a5e9bee8e7fa97721f5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:20:11.692742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:11.694159 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:11.707492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01b2b7-0232-48cf-8cba-688082696f54 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:11.773189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:11.774118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:11.774406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:11.774671 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] PATH_INFO: `/v3/projects/4f74453d20884f3492023c6cdbe52687` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:11.775880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f74453d20884f3492023c6cdbe52687)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:11.777869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:11.815507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:11.829505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f74453d20884f3492023c6cdbe52687', 'request_id': 'req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.835659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f74453d20884f3492023c6cdbe52687', 'request_id': 'req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.844598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f74453d20884f3492023c6cdbe52687', 'request_id': 'req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.856410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] The token cache is being invalidate because project 4f74453d20884f3492023c6cdbe52687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:20:11.856718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.857351 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d9f0818c-4f21-4e0a-85ab-89fe833cc5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:11.858889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1089/2168] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:20:11 2022] DELETE /identity/v3/projects/4f74453d20884f3492023c6cdbe52687 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:11.863892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e987f-074d-43a2-bfaf-150951d37d00 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:11.864182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e987f-074d-43a2-bfaf-150951d37d00 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:11.864454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e987f-074d-43a2-bfaf-150951d37d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:11.885804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d07e987f-074d-43a2-bfaf-150951d37d00 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:11.887405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d07e987f-074d-43a2-bfaf-150951d37d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:11.972232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1080/2169] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:11.980126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814a5f6-1715-40bb-af87-44d50a73bd7c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:11.981214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814a5f6-1715-40bb-af87-44d50a73bd7c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:11.981684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814a5f6-1715-40bb-af87-44d50a73bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.001615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7814a5f6-1715-40bb-af87-44d50a73bd7c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:12.002689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7814a5f6-1715-40bb-af87-44d50a73bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:12.010772 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1090/2170] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:12.015371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e987f-074d-43a2-bfaf-150951d37d00 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:12.026260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e987f-074d-43a2-bfaf-150951d37d00 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:12.031186 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e783fdb-dc74-4156-b82b-f8a9b85caa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:12.031866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783fdb-dc74-4156-b82b-f8a9b85caa72 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.032199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783fdb-dc74-4156-b82b-f8a9b85caa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.032472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783fdb-dc74-4156-b82b-f8a9b85caa72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.033241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e783fdb-dc74-4156-b82b-f8a9b85caa72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:20:12.033546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e783fdb-dc74-4156-b82b-f8a9b85caa72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:12.035285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e783fdb-dc74-4156-b82b-f8a9b85caa72 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:12.047807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1081/2171] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:20:12.051989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814a5f6-1715-40bb-af87-44d50a73bd7c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:12.067514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814a5f6-1715-40bb-af87-44d50a73bd7c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:12.072108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d1d61-d496-43fd-916e-9f9f678bc719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:12.072984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d1d61-d496-43fd-916e-9f9f678bc719 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.073183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d1d61-d496-43fd-916e-9f9f678bc719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.073390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d1d61-d496-43fd-916e-9f9f678bc719 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.074232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d1d61-d496-43fd-916e-9f9f678bc719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:12.076130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d1d61-d496-43fd-916e-9f9f678bc719 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:12.104236 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1091/2172] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:20:12 2022] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:12.108261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e783fdb-dc74-4156-b82b-f8a9b85caa72 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:12.119531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e783fdb-dc74-4156-b82b-f8a9b85caa72 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:12.189141 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9458a-81d3-40ec-a3f2-c4acc2d36319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:12.189815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9458a-81d3-40ec-a3f2-c4acc2d36319 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.190094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9458a-81d3-40ec-a3f2-c4acc2d36319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.190370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9458a-81d3-40ec-a3f2-c4acc2d36319 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.191077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9458a-81d3-40ec-a3f2-c4acc2d36319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:12.193030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9458a-81d3-40ec-a3f2-c4acc2d36319 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:12.217310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1082/2173] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:20:12 2022] POST /identity/v3/users => generated 281 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:20:12.218153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d1d61-d496-43fd-916e-9f9f678bc719 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:12.230846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d1d61-d496-43fd-916e-9f9f678bc719 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:12.236703 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708836-bd5c-4ddd-b2b5-f63b1c8ebca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:12.237504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708836-bd5c-4ddd-b2b5-f63b1c8ebca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.237812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708836-bd5c-4ddd-b2b5-f63b1c8ebca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.238238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708836-bd5c-4ddd-b2b5-f63b1c8ebca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.239380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2708836-bd5c-4ddd-b2b5-f63b1c8ebca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:12.241067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2708836-bd5c-4ddd-b2b5-f63b1c8ebca4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:12.251990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1092/2174] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:12.256226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9458a-81d3-40ec-a3f2-c4acc2d36319 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:12.266515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9458a-81d3-40ec-a3f2-c4acc2d36319 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:12.271522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987306c-8c63-479d-971a-3ff300debdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:12.272176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987306c-8c63-479d-971a-3ff300debdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.272457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987306c-8c63-479d-971a-3ff300debdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.272754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987306c-8c63-479d-971a-3ff300debdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.273476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987306c-8c63-479d-971a-3ff300debdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:12.275064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987306c-8c63-479d-971a-3ff300debdc6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:12.276360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:12.287629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1083/2175] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:20:12.291986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708836-bd5c-4ddd-b2b5-f63b1c8ebca4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:12.302912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708836-bd5c-4ddd-b2b5-f63b1c8ebca4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:12.308259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d40b93-b048-4cfc-be9f-b07479570e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:12.309368 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d40b93-b048-4cfc-be9f-b07479570e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.309649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d40b93-b048-4cfc-be9f-b07479570e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.309923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d40b93-b048-4cfc-be9f-b07479570e0b admin admin] PATH_INFO: `/v3/projects/804dcad6abd2423a85c7ef161da0c527/users/9f8fe30cb6854231b7f095e8e4250478/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.325889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d40b93-b048-4cfc-be9f-b07479570e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=804dcad6abd2423a85c7ef161da0c527, user_id=9f8fe30cb6854231b7f095e8e4250478, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:12.328628 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d40b93-b048-4cfc-be9f-b07479570e0b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:12.343333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1093/2176] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:12 2022] PUT /identity/v3/projects/804dcad6abd2423a85c7ef161da0c527/users/9f8fe30cb6854231b7f095e8e4250478/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:12.355419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda51784-d611-4370-90df-ec9d40260a5c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.355907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda51784-d611-4370-90df-ec9d40260a5c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.356250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda51784-d611-4370-90df-ec9d40260a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.383755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fda51784-d611-4370-90df-ec9d40260a5c None None] MFA Rules not processed for user `9f8fe30cb6854231b7f095e8e4250478`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:12.384990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fda51784-d611-4370-90df-ec9d40260a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:12.449816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1084/2177] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:12.482306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d40b93-b048-4cfc-be9f-b07479570e0b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:12.484278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-77d40b93-b048-4cfc-be9f-b07479570e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:12.542905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d40b93-b048-4cfc-be9f-b07479570e0b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:12.546418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f608fe-e2d7-473f-8403-341170a2db68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:12.547064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f608fe-e2d7-473f-8403-341170a2db68 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.547343 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f608fe-e2d7-473f-8403-341170a2db68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.547615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f608fe-e2d7-473f-8403-341170a2db68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.556314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f608fe-e2d7-473f-8403-341170a2db68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:12.557780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f608fe-e2d7-473f-8403-341170a2db68 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:12.566712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1094/2178] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:20:12.581377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda51784-d611-4370-90df-ec9d40260a5c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:12.661542 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda51784-d611-4370-90df-ec9d40260a5c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:12.666416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:12.667329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.667762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.668038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] PATH_INFO: `/v3/users/9f8fe30cb6854231b7f095e8e4250478` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.669525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8fe30cb6854231b7f095e8e4250478)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:12.671634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:12.730451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8fe30cb6854231b7f095e8e4250478'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:12.731450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8fe30cb6854231b7f095e8e4250478'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:12.742428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8fe30cb6854231b7f095e8e4250478'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:12.750588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8fe30cb6854231b7f095e8e4250478'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:12.751373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8fe30cb6854231b7f095e8e4250478'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:12.769608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1085/2179] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:20:12 2022] DELETE /identity/v3/users/9f8fe30cb6854231b7f095e8e4250478 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:12.774199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5929a-0409-4de7-a038-419445b48751 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.774714 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5929a-0409-4de7-a038-419445b48751 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.774802 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5929a-0409-4de7-a038-419445b48751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.791421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-25c5929a-0409-4de7-a038-419445b48751 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:12.792622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-25c5929a-0409-4de7-a038-419445b48751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:12.846958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:12.863205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1095/2180] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:12.870889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:12.872607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:12.880267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:12.942522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568872d-e5e4-45b3-895a-286b1898c2ee admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:12.946278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7738929-1695-440c-ae6c-bb9996615e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:12.946931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738929-1695-440c-ae6c-bb9996615e26 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:12.947215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738929-1695-440c-ae6c-bb9996615e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:12.947490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738929-1695-440c-ae6c-bb9996615e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:12.958847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7738929-1695-440c-ae6c-bb9996615e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:12.960341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7738929-1695-440c-ae6c-bb9996615e26 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:12.972813 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1086/2181] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:13.341743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5929a-0409-4de7-a038-419445b48751 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:13.343880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-25c5929a-0409-4de7-a038-419445b48751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:13.371096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5929a-0409-4de7-a038-419445b48751 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:13.383679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:13.384567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:13.384886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:13.385158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] PATH_INFO: `/v3/projects/804dcad6abd2423a85c7ef161da0c527` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:13.386472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=804dcad6abd2423a85c7ef161da0c527)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:13.388612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:13.439471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804dcad6abd2423a85c7ef161da0c527', 'request_id': 'req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:13.445739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804dcad6abd2423a85c7ef161da0c527', 'request_id': 'req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:13.454399 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804dcad6abd2423a85c7ef161da0c527', 'request_id': 'req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:13.466248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] The token cache is being invalidate because project 804dcad6abd2423a85c7ef161da0c527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:20:13.466539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:13.467261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b879c8e2-54bf-4b64-aa75-0032ce3c5a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:13.469034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1096/2182] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:20:13 2022] DELETE /identity/v3/projects/804dcad6abd2423a85c7ef161da0c527 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:13.474408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4eee-634f-45c4-a635-b34d528cfe4d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:13.474889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4eee-634f-45c4-a635-b34d528cfe4d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:13.474995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4eee-634f-45c4-a635-b34d528cfe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:13.493815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a9cb4eee-634f-45c4-a635-b34d528cfe4d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:13.495019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a9cb4eee-634f-45c4-a635-b34d528cfe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:13.572773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1087/2183] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:20:13.581312 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6249da-c8ff-45f9-bd99-16118d6c845e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:13.581508 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6249da-c8ff-45f9-bd99-16118d6c845e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:13.581820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6249da-c8ff-45f9-bd99-16118d6c845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:13.602457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4f6249da-c8ff-45f9-bd99-16118d6c845e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:13.603680 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4f6249da-c8ff-45f9-bd99-16118d6c845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:13.612928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1097/2184] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:13.617398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb4eee-634f-45c4-a635-b34d528cfe4d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:13.627895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb4eee-634f-45c4-a635-b34d528cfe4d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:13.633605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0114ee2-ac8d-4dea-b799-5ce7760ece31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:13.634267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0114ee2-ac8d-4dea-b799-5ce7760ece31 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:13.634553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0114ee2-ac8d-4dea-b799-5ce7760ece31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:13.634827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0114ee2-ac8d-4dea-b799-5ce7760ece31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:13.635563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0114ee2-ac8d-4dea-b799-5ce7760ece31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:20:13.635873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0114ee2-ac8d-4dea-b799-5ce7760ece31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:13.637602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0114ee2-ac8d-4dea-b799-5ce7760ece31 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:13.649972 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1088/2185] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:20:13.654336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6249da-c8ff-45f9-bd99-16118d6c845e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:13.664404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6249da-c8ff-45f9-bd99-16118d6c845e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:13.670181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806c023-f547-44a5-8129-b7667c82ff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:13.670906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806c023-f547-44a5-8129-b7667c82ff93 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:13.671196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806c023-f547-44a5-8129-b7667c82ff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:13.671475 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806c023-f547-44a5-8129-b7667c82ff93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:13.672174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806c023-f547-44a5-8129-b7667c82ff93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:13.674123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806c023-f547-44a5-8129-b7667c82ff93 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:13.705742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1098/2186] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:20:13 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:13.710136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0114ee2-ac8d-4dea-b799-5ce7760ece31 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:13.720424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0114ee2-ac8d-4dea-b799-5ce7760ece31 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:13.785413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e45ab-6212-42a1-92ac-9237ce02423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:13.786084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e45ab-6212-42a1-92ac-9237ce02423d admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:13.786364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e45ab-6212-42a1-92ac-9237ce02423d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:13.786635 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e45ab-6212-42a1-92ac-9237ce02423d admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:13.787334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e45ab-6212-42a1-92ac-9237ce02423d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:13.789335 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e45ab-6212-42a1-92ac-9237ce02423d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:13.810693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1089/2187] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:20:13 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:20:13.815035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806c023-f547-44a5-8129-b7667c82ff93 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:13.825774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806c023-f547-44a5-8129-b7667c82ff93 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:13.831023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425628dd-ee9c-4d2e-b88d-c352fae49904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:13.831751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425628dd-ee9c-4d2e-b88d-c352fae49904 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:13.831968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425628dd-ee9c-4d2e-b88d-c352fae49904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:13.832240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425628dd-ee9c-4d2e-b88d-c352fae49904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:13.832998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425628dd-ee9c-4d2e-b88d-c352fae49904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:13.834614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425628dd-ee9c-4d2e-b88d-c352fae49904 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:13.845509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1099/2188] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:13.849997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e45ab-6212-42a1-92ac-9237ce02423d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:13.862368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e45ab-6212-42a1-92ac-9237ce02423d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:13.868032 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b7059-2e56-44cc-a724-d06196f412d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:13.868701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b7059-2e56-44cc-a724-d06196f412d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:13.868997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b7059-2e56-44cc-a724-d06196f412d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:13.869267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b7059-2e56-44cc-a724-d06196f412d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:13.869996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b7059-2e56-44cc-a724-d06196f412d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:13.871870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b7059-2e56-44cc-a724-d06196f412d1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:13.882191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1090/2189] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:13.886413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425628dd-ee9c-4d2e-b88d-c352fae49904 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:13.898670 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425628dd-ee9c-4d2e-b88d-c352fae49904 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:13.906207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7ce27-b0cc-467f-8217-8fbb16703584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:13.907105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ce27-b0cc-467f-8217-8fbb16703584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:13.907394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ce27-b0cc-467f-8217-8fbb16703584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:13.907668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ce27-b0cc-467f-8217-8fbb16703584 admin admin] PATH_INFO: `/v3/projects/290e9bd74e5e4d36a41e7874f952389b/users/1b62d69933b14a789f35bfe0570b3650/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:13.926901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7ce27-b0cc-467f-8217-8fbb16703584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290e9bd74e5e4d36a41e7874f952389b, user_id=1b62d69933b14a789f35bfe0570b3650, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:13.931054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7ce27-b0cc-467f-8217-8fbb16703584 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:13.946408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1100/2190] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:13 2022] PUT /identity/v3/projects/290e9bd74e5e4d36a41e7874f952389b/users/1b62d69933b14a789f35bfe0570b3650/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:20:13.956937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb0ca0-642e-460d-b4f2-2a82d22a6355 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:13.957228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb0ca0-642e-460d-b4f2-2a82d22a6355 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:13.957505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb0ca0-642e-460d-b4f2-2a82d22a6355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:13.983036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:13.986608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d0bb0ca0-642e-460d-b4f2-2a82d22a6355 None None] MFA Rules not processed for user `1b62d69933b14a789f35bfe0570b3650`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:13.988609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d0bb0ca0-642e-460d-b4f2-2a82d22a6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:14.064210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1091/2191] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:14.075920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7ce27-b0cc-467f-8217-8fbb16703584 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:14.077983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f9c7ce27-b0cc-467f-8217-8fbb16703584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:14.151011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7ce27-b0cc-467f-8217-8fbb16703584 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:14.155606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459999de-9b7d-407f-b5e1-a1c54219574e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:14.156261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459999de-9b7d-407f-b5e1-a1c54219574e service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:14.156547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459999de-9b7d-407f-b5e1-a1c54219574e service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:14.156851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459999de-9b7d-407f-b5e1-a1c54219574e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:14.165640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459999de-9b7d-407f-b5e1-a1c54219574e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:14.167078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459999de-9b7d-407f-b5e1-a1c54219574e service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:14.176362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1101/2192] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:15.622456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e81f-939b-4e4f-a8d2-743aeb8277e2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:15.622914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e81f-939b-4e4f-a8d2-743aeb8277e2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:15.623029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e81f-939b-4e4f-a8d2-743aeb8277e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:15.642112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7ee4e81f-939b-4e4f-a8d2-743aeb8277e2 None None] MFA Rules not processed for user `1b62d69933b14a789f35bfe0570b3650`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:15.643318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7ee4e81f-939b-4e4f-a8d2-743aeb8277e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:15.650577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1092/2193] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:16.471230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459999de-9b7d-407f-b5e1-a1c54219574e service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:16.472811 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-459999de-9b7d-407f-b5e1-a1c54219574e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:16.499690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:16.557211 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459999de-9b7d-407f-b5e1-a1c54219574e service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:16.562793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:16.563690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:16.563976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:16.564251 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] PATH_INFO: `/v3/users/63d1f034ccd543ff824c097bfa9725e9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:16.565538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d1f034ccd543ff824c097bfa9725e9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:16.568032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:16.619680 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d1f034ccd543ff824c097bfa9725e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:16.627865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d1f034ccd543ff824c097bfa9725e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:16.628465 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d1f034ccd543ff824c097bfa9725e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:16.635355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d1f034ccd543ff824c097bfa9725e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:16.635999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d1f034ccd543ff824c097bfa9725e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:16.657699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1102/2194] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:20:16 2022] DELETE /identity/v3/users/63d1f034ccd543ff824c097bfa9725e9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:16.663750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579eb1e-b227-45e1-82b9-c7b46adc66e9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:16.664188 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579eb1e-b227-45e1-82b9-c7b46adc66e9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:16.664293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579eb1e-b227-45e1-82b9-c7b46adc66e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:16.685615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5579eb1e-b227-45e1-82b9-c7b46adc66e9 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:16.686669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5579eb1e-b227-45e1-82b9-c7b46adc66e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:16.755640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1093/2195] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:16.765592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:16.767005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:16.827022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36a32f-e15b-4e4e-8a2d-73275eeb0397 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:16.831195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1f2a0-b858-426c-ae9d-db1f39e21775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:16.831867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f2a0-b858-426c-ae9d-db1f39e21775 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:16.832142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f2a0-b858-426c-ae9d-db1f39e21775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:16.832407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f2a0-b858-426c-ae9d-db1f39e21775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:16.842504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1f2a0-b858-426c-ae9d-db1f39e21775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:16.844092 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1f2a0-b858-426c-ae9d-db1f39e21775 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:16.855081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1103/2196] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:17.239329 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579eb1e-b227-45e1-82b9-c7b46adc66e9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:17.241657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5579eb1e-b227-45e1-82b9-c7b46adc66e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:17.266208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579eb1e-b227-45e1-82b9-c7b46adc66e9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:17.271198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:17.272134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:17.272418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:17.272714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] PATH_INFO: `/v3/users/a307f69420c64989975bf1075ac78c65` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:17.273934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a307f69420c64989975bf1075ac78c65)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:17.275863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:17.342135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a307f69420c64989975bf1075ac78c65'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:17.342881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a307f69420c64989975bf1075ac78c65'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:17.352850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a307f69420c64989975bf1075ac78c65'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:17.367273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a307f69420c64989975bf1075ac78c65'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:17.368105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a307f69420c64989975bf1075ac78c65'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:17.398927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1094/2197] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:20:17 2022] DELETE /identity/v3/users/a307f69420c64989975bf1075ac78c65 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:17.404205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f5691-2117-444b-8de9-c42696f93d81 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:17.404531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f5691-2117-444b-8de9-c42696f93d81 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:17.404831 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f5691-2117-444b-8de9-c42696f93d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:17.425309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-265f5691-2117-444b-8de9-c42696f93d81 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:17.426531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-265f5691-2117-444b-8de9-c42696f93d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:17.462183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:17.476435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:17.477981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:17.498379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:17.509479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1104/2198] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:20:17.516906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f5691-2117-444b-8de9-c42696f93d81 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:17.518650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-265f5691-2117-444b-8de9-c42696f93d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:17.561441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f419991-2e4a-4307-8a22-58bd9873e8b6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:17.566225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:17.567097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:17.567384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:17.567655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] PATH_INFO: `/v3/projects/b7036bd5625e44169bdaa182ebf9e3b3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:17.568860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7036bd5625e44169bdaa182ebf9e3b3)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:17.570991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:17.580768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f5691-2117-444b-8de9-c42696f93d81 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:17.584684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a3b11-7000-4031-a174-4ff015f49b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:17.585404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a3b11-7000-4031-a174-4ff015f49b2f service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:17.585851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a3b11-7000-4031-a174-4ff015f49b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:17.586128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a3b11-7000-4031-a174-4ff015f49b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:17.595262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a3b11-7000-4031-a174-4ff015f49b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:17.596761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a3b11-7000-4031-a174-4ff015f49b2f service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:17.607748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1105/2199] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:20:17.621554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7036bd5625e44169bdaa182ebf9e3b3', 'request_id': 'req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:17.634702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7036bd5625e44169bdaa182ebf9e3b3', 'request_id': 'req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:17.642411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7036bd5625e44169bdaa182ebf9e3b3', 'request_id': 'req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:17.654593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] The token cache is being invalidate because project b7036bd5625e44169bdaa182ebf9e3b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:20:17.654949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:17.655978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-04ba2937-c6e6-4c3b-9889-ae1b7f9ffc11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:17.657310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1095/2200] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:20:17 2022] DELETE /identity/v3/projects/b7036bd5625e44169bdaa182ebf9e3b3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:17.662534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de52f95-23e4-42ef-9eb5-57980ed5b7e8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:17.662830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de52f95-23e4-42ef-9eb5-57980ed5b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:17.663123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de52f95-23e4-42ef-9eb5-57980ed5b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:17.682139 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5de52f95-23e4-42ef-9eb5-57980ed5b7e8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:17.683365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5de52f95-23e4-42ef-9eb5-57980ed5b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:17.749030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1106/2201] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:17.757380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1573-4cdd-4df1-987a-8435e078250f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:17.757901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1573-4cdd-4df1-987a-8435e078250f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:17.757995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1573-4cdd-4df1-987a-8435e078250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:17.778740 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d09a1573-4cdd-4df1-987a-8435e078250f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:17.780000 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d09a1573-4cdd-4df1-987a-8435e078250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:17.788121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1096/2202] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:17.793207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de52f95-23e4-42ef-9eb5-57980ed5b7e8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:17.803830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de52f95-23e4-42ef-9eb5-57980ed5b7e8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:17.809012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9d23b-62d7-454e-9d85-f0e0bf42c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:17.809909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d23b-62d7-454e-9d85-f0e0bf42c5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:17.810193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d23b-62d7-454e-9d85-f0e0bf42c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:17.810468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d23b-62d7-454e-9d85-f0e0bf42c5a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:17.811207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9d23b-62d7-454e-9d85-f0e0bf42c5a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:20:17.811511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9d23b-62d7-454e-9d85-f0e0bf42c5a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:17.813148 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9d23b-62d7-454e-9d85-f0e0bf42c5a6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:17.826311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1107/2203] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:20:17.830950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a1573-4cdd-4df1-987a-8435e078250f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:17.841382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a1573-4cdd-4df1-987a-8435e078250f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:17.846597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7bed-9110-4aac-bb39-57c3305d653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:17.847267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7bed-9110-4aac-bb39-57c3305d653e admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:17.847538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7bed-9110-4aac-bb39-57c3305d653e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:17.847810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7bed-9110-4aac-bb39-57c3305d653e admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:17.848505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c7bed-9110-4aac-bb39-57c3305d653e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:17.850758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c7bed-9110-4aac-bb39-57c3305d653e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:17.884291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1097/2204] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:20:17 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:17.889091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9d23b-62d7-454e-9d85-f0e0bf42c5a6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:17.900913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9d23b-62d7-454e-9d85-f0e0bf42c5a6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:17.906685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7bed-9110-4aac-bb39-57c3305d653e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:17.912346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ec5c7bed-9110-4aac-bb39-57c3305d653e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:17.979717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc527021-d363-4271-9d76-38dbca258529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:17.980598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc527021-d363-4271-9d76-38dbca258529 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:17.980903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc527021-d363-4271-9d76-38dbca258529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:17.981308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc527021-d363-4271-9d76-38dbca258529 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:17.982041 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc527021-d363-4271-9d76-38dbca258529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:17.984073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc527021-d363-4271-9d76-38dbca258529 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:17.995542 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7bed-9110-4aac-bb39-57c3305d653e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.000827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.001694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.001979 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.002248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] PATH_INFO: `/v3/projects/ce64d2b69c794fdeac1d1ad3aee85af1` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.003427 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce64d2b69c794fdeac1d1ad3aee85af1)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.005363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.005475 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1108/2205] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:20:17 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:20:18.009347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc527021-d363-4271-9d76-38dbca258529 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.014553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:18.020629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc527021-d363-4271-9d76-38dbca258529 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.021187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:18.032464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93780e56-0baf-4aa3-a0b0-7eb483028752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.033182 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93780e56-0baf-4aa3-a0b0-7eb483028752 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.033462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93780e56-0baf-4aa3-a0b0-7eb483028752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.033736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93780e56-0baf-4aa3-a0b0-7eb483028752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.034466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93780e56-0baf-4aa3-a0b0-7eb483028752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.036093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93780e56-0baf-4aa3-a0b0-7eb483028752 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.048174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1109/2206] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:20:18.054213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93780e56-0baf-4aa3-a0b0-7eb483028752 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.066397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93780e56-0baf-4aa3-a0b0-7eb483028752 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.069706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce64d2b69c794fdeac1d1ad3aee85af1', 'request_id': 'req-35eae2fa-7476-4942-8fef-3d528204d529'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:18.078046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce64d2b69c794fdeac1d1ad3aee85af1', 'request_id': 'req-35eae2fa-7476-4942-8fef-3d528204d529'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:18.084802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce64d2b69c794fdeac1d1ad3aee85af1', 'request_id': 'req-35eae2fa-7476-4942-8fef-3d528204d529'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:18.095804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] The token cache is being invalidate because project ce64d2b69c794fdeac1d1ad3aee85af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:20:18.096225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:18.097408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-35eae2fa-7476-4942-8fef-3d528204d529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:18.099391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1098/2207] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:20:17 2022] DELETE /identity/v3/projects/ce64d2b69c794fdeac1d1ad3aee85af1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:18.104370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37dde7-dba2-4eba-9675-8415fa89219a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.104679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37dde7-dba2-4eba-9675-8415fa89219a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.104958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37dde7-dba2-4eba-9675-8415fa89219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.123146 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6f37dde7-dba2-4eba-9675-8415fa89219a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:18.124347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6f37dde7-dba2-4eba-9675-8415fa89219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:18.126317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aed6c-5790-4a86-8186-9b510d343b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.127026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aed6c-5790-4a86-8186-9b510d343b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.127314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aed6c-5790-4a86-8186-9b510d343b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.127591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aed6c-5790-4a86-8186-9b510d343b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.128326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aed6c-5790-4a86-8186-9b510d343b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.129967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aed6c-5790-4a86-8186-9b510d343b74 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.132434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1099/2208] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:18.140475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9505e-be94-4a86-9fac-9221b2870571 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.140786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9505e-be94-4a86-9fac-9221b2870571 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.141056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9505e-be94-4a86-9fac-9221b2870571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.141546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1110/2209] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:20:18.145774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aed6c-5790-4a86-8186-9b510d343b74 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.147443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3c3aed6c-5790-4a86-8186-9b510d343b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:18.160517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3cc9505e-be94-4a86-9fac-9221b2870571 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:18.161269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aed6c-5790-4a86-8186-9b510d343b74 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.161763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3cc9505e-be94-4a86-9fac-9221b2870571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:18.166101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294643b-abaa-4e97-ae70-b29be6b0c111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.167005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294643b-abaa-4e97-ae70-b29be6b0c111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.167290 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294643b-abaa-4e97-ae70-b29be6b0c111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.167578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294643b-abaa-4e97-ae70-b29be6b0c111 admin admin] PATH_INFO: `/v3/projects/d45feb024846460784f2d23275e37d2e/users/05a41c68071b4a2ea55379e3fa2cd94c/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.170008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1100/2210] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:20:18.174484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9505e-be94-4a86-9fac-9221b2870571 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.183626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9505e-be94-4a86-9fac-9221b2870571 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.183843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294643b-abaa-4e97-ae70-b29be6b0c111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45feb024846460784f2d23275e37d2e, user_id=05a41c68071b4a2ea55379e3fa2cd94c, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.186619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294643b-abaa-4e97-ae70-b29be6b0c111 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.188370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19335eb7-cedc-49e0-a026-6bc969ba0de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.189073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19335eb7-cedc-49e0-a026-6bc969ba0de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.189358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19335eb7-cedc-49e0-a026-6bc969ba0de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.189637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19335eb7-cedc-49e0-a026-6bc969ba0de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.190404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19335eb7-cedc-49e0-a026-6bc969ba0de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:20:18.190797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19335eb7-cedc-49e0-a026-6bc969ba0de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.192627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19335eb7-cedc-49e0-a026-6bc969ba0de5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.201426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1111/2211] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:18 2022] PUT /identity/v3/projects/d45feb024846460784f2d23275e37d2e/users/05a41c68071b4a2ea55379e3fa2cd94c/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:20:18.212714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1101/2212] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:20:18.212916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294643b-abaa-4e97-ae70-b29be6b0c111 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.214746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50119c-d102-417a-bb46-cea76f07f201 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.215140 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50119c-d102-417a-bb46-cea76f07f201 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.215423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50119c-d102-417a-bb46-cea76f07f201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.244863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-dd50119c-d102-417a-bb46-cea76f07f201 None None] MFA Rules not processed for user `05a41c68071b4a2ea55379e3fa2cd94c`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:18.246380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dd50119c-d102-417a-bb46-cea76f07f201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:18.293848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294643b-abaa-4e97-ae70-b29be6b0c111 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.299234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634f0cf-4294-4edf-85c6-40a8a90bb74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.299978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634f0cf-4294-4edf-85c6-40a8a90bb74a admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.300335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634f0cf-4294-4edf-85c6-40a8a90bb74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.300739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634f0cf-4294-4edf-85c6-40a8a90bb74a admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.301515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634f0cf-4294-4edf-85c6-40a8a90bb74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.303522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634f0cf-4294-4edf-85c6-40a8a90bb74a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.325428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1102/2213] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:18.337119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50119c-d102-417a-bb46-cea76f07f201 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.338834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dd50119c-d102-417a-bb46-cea76f07f201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:18.341483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1112/2214] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:20:18 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:20:18.345816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634f0cf-4294-4edf-85c6-40a8a90bb74a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.408431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50119c-d102-417a-bb46-cea76f07f201 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.414125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:18.435549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634f0cf-4294-4edf-85c6-40a8a90bb74a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.446651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2da3b-f1ec-435c-af82-ca2c545659e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.447468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2da3b-f1ec-435c-af82-ca2c545659e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.447759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2da3b-f1ec-435c-af82-ca2c545659e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.450089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2da3b-f1ec-435c-af82-ca2c545659e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.450839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2da3b-f1ec-435c-af82-ca2c545659e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.452775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:18.456243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2da3b-f1ec-435c-af82-ca2c545659e5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.507497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1113/2215] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:20:18 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:20:18.511244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2da3b-f1ec-435c-af82-ca2c545659e5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.512333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f096f-2c80-48e4-a453-8f9db1649b14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.513293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f096f-2c80-48e4-a453-8f9db1649b14 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.513765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f096f-2c80-48e4-a453-8f9db1649b14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.514202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f096f-2c80-48e4-a453-8f9db1649b14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.523197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2da3b-f1ec-435c-af82-ca2c545659e5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.544028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6803da-9d66-45c8-b009-52969c095327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.544028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6803da-9d66-45c8-b009-52969c095327 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.544028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6803da-9d66-45c8-b009-52969c095327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.544028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6803da-9d66-45c8-b009-52969c095327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.544526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6803da-9d66-45c8-b009-52969c095327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.544526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6803da-9d66-45c8-b009-52969c095327 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.555261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1114/2216] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:20:18.559224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6803da-9d66-45c8-b009-52969c095327 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.570378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6803da-9d66-45c8-b009-52969c095327 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.576637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5885c32-4a94-4512-a91f-da461bf43d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.577349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5885c32-4a94-4512-a91f-da461bf43d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.577634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5885c32-4a94-4512-a91f-da461bf43d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.577911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5885c32-4a94-4512-a91f-da461bf43d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.578760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5885c32-4a94-4512-a91f-da461bf43d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.580618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5885c32-4a94-4512-a91f-da461bf43d90 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.586260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f096f-2c80-48e4-a453-8f9db1649b14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.588432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f096f-2c80-48e4-a453-8f9db1649b14 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.597515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1115/2217] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:18.601409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5885c32-4a94-4512-a91f-da461bf43d90 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.607902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1103/2218] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:20:18.624110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5885c32-4a94-4512-a91f-da461bf43d90 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.631775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f3fb-c4f4-414f-8335-0abb1f608e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.632793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f3fb-c4f4-414f-8335-0abb1f608e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.633065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f3fb-c4f4-414f-8335-0abb1f608e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.633380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9f3fb-c4f4-414f-8335-0abb1f608e4d admin admin] PATH_INFO: `/v3/projects/b545bb60674745b8a2d06663e9cff90a/users/5ba9be3543884f02bd15c95b0dbbe644/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.651824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9f3fb-c4f4-414f-8335-0abb1f608e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b545bb60674745b8a2d06663e9cff90a, user_id=5ba9be3543884f02bd15c95b0dbbe644, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.660536 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9f3fb-c4f4-414f-8335-0abb1f608e4d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.681839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1116/2219] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:18 2022] PUT /identity/v3/projects/b545bb60674745b8a2d06663e9cff90a/users/5ba9be3543884f02bd15c95b0dbbe644/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:20:18.687298 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101700-fa5b-495d-9946-cd6a89e9dfc5 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.687818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101700-fa5b-495d-9946-cd6a89e9dfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.688276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101700-fa5b-495d-9946-cd6a89e9dfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.714655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d3101700-fa5b-495d-9946-cd6a89e9dfc5 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:18.717626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d3101700-fa5b-495d-9946-cd6a89e9dfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:18.804962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1104/2220] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:18.819947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f3fb-c4f4-414f-8335-0abb1f608e4d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:18.821806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3cd9f3fb-c4f4-414f-8335-0abb1f608e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:18.890458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9f3fb-c4f4-414f-8335-0abb1f608e4d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:18.894341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727ad9f-1e78-428e-a0d0-c7dc6e86dfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:18.895003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ad9f-1e78-428e-a0d0-c7dc6e86dfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:18.895600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ad9f-1e78-428e-a0d0-c7dc6e86dfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:18.895878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ad9f-1e78-428e-a0d0-c7dc6e86dfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:18.907332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727ad9f-1e78-428e-a0d0-c7dc6e86dfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:18.909110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727ad9f-1e78-428e-a0d0-c7dc6e86dfd7 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:18.923953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1117/2221] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:19.665537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2447-b359-43e6-9047-d5f08877d385 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:19.665903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2447-b359-43e6-9047-d5f08877d385 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:19.666262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2447-b359-43e6-9047-d5f08877d385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:19.720113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a09f2447-b359-43e6-9047-d5f08877d385 None None] MFA Rules not processed for user `5ba9be3543884f02bd15c95b0dbbe644`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:19.722792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a09f2447-b359-43e6-9047-d5f08877d385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:19.818433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1105/2222] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:19.830220 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727ad9f-1e78-428e-a0d0-c7dc6e86dfd7 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:19.831821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2727ad9f-1e78-428e-a0d0-c7dc6e86dfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:19.909441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727ad9f-1e78-428e-a0d0-c7dc6e86dfd7 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:19.913062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e28386-811e-4782-add5-76f5b3db8f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:19.913933 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e28386-811e-4782-add5-76f5b3db8f42 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:19.914363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e28386-811e-4782-add5-76f5b3db8f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:19.915201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e28386-811e-4782-add5-76f5b3db8f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:19.929035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e28386-811e-4782-add5-76f5b3db8f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:19.930805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e28386-811e-4782-add5-76f5b3db8f42 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:19.943066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1118/2223] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:21.500347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c376e3f-2819-4299-9e6e-5e49d8626fe6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:21.501374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c376e3f-2819-4299-9e6e-5e49d8626fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:21.501662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c376e3f-2819-4299-9e6e-5e49d8626fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:21.510188 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:21.540403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7c376e3f-2819-4299-9e6e-5e49d8626fe6 None None] MFA Rules not processed for user `5ba9be3543884f02bd15c95b0dbbe644`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:21.545359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7c376e3f-2819-4299-9e6e-5e49d8626fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:21.566110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1106/2224] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:29.144507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e28386-811e-4782-add5-76f5b3db8f42 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:29.157448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e28386-811e-4782-add5-76f5b3db8f42 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:29.162234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:29.163135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:29.163418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:29.163692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] PATH_INFO: `/v3/users/05a41c68071b4a2ea55379e3fa2cd94c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:29.164955 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a41c68071b4a2ea55379e3fa2cd94c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:29.167292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:29.223184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:29.242111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a41c68071b4a2ea55379e3fa2cd94c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:29.249905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a41c68071b4a2ea55379e3fa2cd94c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:29.250626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a41c68071b4a2ea55379e3fa2cd94c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:29.261404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a41c68071b4a2ea55379e3fa2cd94c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:29.262259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a41c68071b4a2ea55379e3fa2cd94c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:29.287746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1119/2225] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:20:29 2022] DELETE /identity/v3/users/05a41c68071b4a2ea55379e3fa2cd94c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:29.292739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da5a74-2389-48dc-9843-e80a17fbb2af None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:29.293191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da5a74-2389-48dc-9843-e80a17fbb2af None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:29.293312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da5a74-2389-48dc-9843-e80a17fbb2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:29.311297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-43da5a74-2389-48dc-9843-e80a17fbb2af None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:29.312846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-43da5a74-2389-48dc-9843-e80a17fbb2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:29.385773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1107/2226] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:29.396243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:29.397798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:29.485752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0268ebe-48bf-47a0-a8a1-e822bdaf6c08 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:29.489665 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c6c93-6439-49cb-8ee1-6689eb27faaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:29.490332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c6c93-6439-49cb-8ee1-6689eb27faaa service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:29.490618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c6c93-6439-49cb-8ee1-6689eb27faaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:29.490896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c6c93-6439-49cb-8ee1-6689eb27faaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:29.503500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c6c93-6439-49cb-8ee1-6689eb27faaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:29.503500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c6c93-6439-49cb-8ee1-6689eb27faaa service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:29.514221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1120/2227] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:29.858268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da5a74-2389-48dc-9843-e80a17fbb2af None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:29.859919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-43da5a74-2389-48dc-9843-e80a17fbb2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:29.873137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da5a74-2389-48dc-9843-e80a17fbb2af None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:29.878982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:29.879947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:29.880328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:29.880717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] PATH_INFO: `/v3/projects/d45feb024846460784f2d23275e37d2e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:29.882421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45feb024846460784f2d23275e37d2e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:29.884409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:29.931884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45feb024846460784f2d23275e37d2e', 'request_id': 'req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:29.940157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45feb024846460784f2d23275e37d2e', 'request_id': 'req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:29.946957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45feb024846460784f2d23275e37d2e', 'request_id': 'req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:29.957469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] The token cache is being invalidate because project d45feb024846460784f2d23275e37d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:20:29.957759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:29.958406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ed62b6d-1029-4f59-aad2-687bcd9e0abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:29.960057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1108/2228] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:20:29 2022] DELETE /identity/v3/projects/d45feb024846460784f2d23275e37d2e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:29.965464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e21a4-32ed-4d4d-8119-3e693131ae5c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:29.965756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e21a4-32ed-4d4d-8119-3e693131ae5c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:29.966038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e21a4-32ed-4d4d-8119-3e693131ae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:29.984654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-be5e21a4-32ed-4d4d-8119-3e693131ae5c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:29.986257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-be5e21a4-32ed-4d4d-8119-3e693131ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:30.066329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1121/2229] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:30.074092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a798c-aed8-4af1-914a-03778911bb7d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:30.074447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a798c-aed8-4af1-914a-03778911bb7d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:30.074786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a798c-aed8-4af1-914a-03778911bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:30.094052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-348a798c-aed8-4af1-914a-03778911bb7d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:30.095243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-348a798c-aed8-4af1-914a-03778911bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:30.103824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1109/2230] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:30.107993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e21a4-32ed-4d4d-8119-3e693131ae5c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:30.118105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e21a4-32ed-4d4d-8119-3e693131ae5c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:30.122696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb5bda-9c1a-41f0-a462-387122b49a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:30.123375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb5bda-9c1a-41f0-a462-387122b49a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:30.123652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb5bda-9c1a-41f0-a462-387122b49a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:30.123957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb5bda-9c1a-41f0-a462-387122b49a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:30.124785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb5bda-9c1a-41f0-a462-387122b49a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:20:30.125282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb5bda-9c1a-41f0-a462-387122b49a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:30.126890 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb5bda-9c1a-41f0-a462-387122b49a8e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:30.142037 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1122/2231] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:20:30.143504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a798c-aed8-4af1-914a-03778911bb7d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:30.154385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a798c-aed8-4af1-914a-03778911bb7d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:30.159564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc30004-556f-4a00-a93a-56f2e0f5aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:30.160330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc30004-556f-4a00-a93a-56f2e0f5aa93 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:30.160621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc30004-556f-4a00-a93a-56f2e0f5aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:30.160939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc30004-556f-4a00-a93a-56f2e0f5aa93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:30.161901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc30004-556f-4a00-a93a-56f2e0f5aa93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:30.163837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc30004-556f-4a00-a93a-56f2e0f5aa93 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:30.193555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1110/2232] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:20:30 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:30.198090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb5bda-9c1a-41f0-a462-387122b49a8e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:30.210291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb5bda-9c1a-41f0-a462-387122b49a8e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:30.258776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:30.288280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285fd70-4d73-4f52-998d-7dea9d7ef010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:30.289174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285fd70-4d73-4f52-998d-7dea9d7ef010 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:30.289463 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285fd70-4d73-4f52-998d-7dea9d7ef010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:30.289742 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285fd70-4d73-4f52-998d-7dea9d7ef010 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:30.290490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285fd70-4d73-4f52-998d-7dea9d7ef010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:30.293421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285fd70-4d73-4f52-998d-7dea9d7ef010 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:30.318654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1123/2233] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:20:30 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:30.322860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc30004-556f-4a00-a93a-56f2e0f5aa93 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:30.338293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc30004-556f-4a00-a93a-56f2e0f5aa93 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:30.343226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856d971-ece1-493f-bc0d-e92997a4dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:30.344278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856d971-ece1-493f-bc0d-e92997a4dc6d admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:30.344544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856d971-ece1-493f-bc0d-e92997a4dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:30.344852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856d971-ece1-493f-bc0d-e92997a4dc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:30.345591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856d971-ece1-493f-bc0d-e92997a4dc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:30.347198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856d971-ece1-493f-bc0d-e92997a4dc6d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:30.358351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1111/2234] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:20:30.362523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285fd70-4d73-4f52-998d-7dea9d7ef010 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:30.372950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285fd70-4d73-4f52-998d-7dea9d7ef010 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:30.380985 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f3159-1be0-443b-bc3c-eddcd71544c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:30.381687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f3159-1be0-443b-bc3c-eddcd71544c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:30.382271 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f3159-1be0-443b-bc3c-eddcd71544c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:30.382550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f3159-1be0-443b-bc3c-eddcd71544c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:30.383288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f3159-1be0-443b-bc3c-eddcd71544c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:30.384952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f3159-1be0-443b-bc3c-eddcd71544c7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:30.397091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1124/2235] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:30.401818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856d971-ece1-493f-bc0d-e92997a4dc6d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:30.418326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856d971-ece1-493f-bc0d-e92997a4dc6d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:30.425708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49244df7-8b2a-4af2-be24-3912c7fdde6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:30.426716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49244df7-8b2a-4af2-be24-3912c7fdde6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:30.427674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49244df7-8b2a-4af2-be24-3912c7fdde6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:30.428531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49244df7-8b2a-4af2-be24-3912c7fdde6d admin admin] PATH_INFO: `/v3/projects/bae79cca54fb4fa28705c48d30410bd0/users/59941fa402854b44a5b7feebdbd2c5cf/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:30.447684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49244df7-8b2a-4af2-be24-3912c7fdde6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae79cca54fb4fa28705c48d30410bd0, user_id=59941fa402854b44a5b7feebdbd2c5cf, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:30.454443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49244df7-8b2a-4af2-be24-3912c7fdde6d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:30.469586 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1112/2236] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:30 2022] PUT /identity/v3/projects/bae79cca54fb4fa28705c48d30410bd0/users/59941fa402854b44a5b7feebdbd2c5cf/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:20:30.474669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ce77-c5cd-46bc-bee3-2fb97b0bbe76 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:30.474959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ce77-c5cd-46bc-bee3-2fb97b0bbe76 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:30.475238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ce77-c5cd-46bc-bee3-2fb97b0bbe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:30.493279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-04c8ce77-c5cd-46bc-bee3-2fb97b0bbe76 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:30.494475 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-04c8ce77-c5cd-46bc-bee3-2fb97b0bbe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:30.570246 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1125/2237] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:30.573456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49244df7-8b2a-4af2-be24-3912c7fdde6d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:30.575170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-49244df7-8b2a-4af2-be24-3912c7fdde6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:30.597960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:30.640851 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49244df7-8b2a-4af2-be24-3912c7fdde6d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:30.644644 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facd847-73b9-4dc8-8045-6cdba4c1615a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:30.645275 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facd847-73b9-4dc8-8045-6cdba4c1615a service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:30.645691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facd847-73b9-4dc8-8045-6cdba4c1615a service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:30.646154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facd847-73b9-4dc8-8045-6cdba4c1615a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:30.656045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facd847-73b9-4dc8-8045-6cdba4c1615a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:30.657635 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facd847-73b9-4dc8-8045-6cdba4c1615a service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:30.667719 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1113/2238] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:36.007210 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0bda-3ccc-411d-8937-ff7fbd95ba08 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:36.007856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0bda-3ccc-411d-8937-ff7fbd95ba08 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:36.008103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0bda-3ccc-411d-8937-ff7fbd95ba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:36.039826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-91aa0bda-3ccc-411d-8937-ff7fbd95ba08 None None] MFA Rules not processed for user `59941fa402854b44a5b7feebdbd2c5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:36.041107 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-91aa0bda-3ccc-411d-8937-ff7fbd95ba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:36.111071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1126/2239] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:36.115635 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facd847-73b9-4dc8-8045-6cdba4c1615a service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:36.125862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facd847-73b9-4dc8-8045-6cdba4c1615a service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:36.130724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865aa5e-a581-4f40-8cf3-63f37e03960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:36.131369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865aa5e-a581-4f40-8cf3-63f37e03960b admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:36.131655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865aa5e-a581-4f40-8cf3-63f37e03960b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:36.131940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865aa5e-a581-4f40-8cf3-63f37e03960b admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:36.132637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865aa5e-a581-4f40-8cf3-63f37e03960b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:36.134619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865aa5e-a581-4f40-8cf3-63f37e03960b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:36.163297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1114/2240] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:20:36 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:36.167358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa0bda-3ccc-411d-8937-ff7fbd95ba08 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:36.179712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa0bda-3ccc-411d-8937-ff7fbd95ba08 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:36.246407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:36.259535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae78329-8a8a-47ef-99ec-1bc57896f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:36.260360 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae78329-8a8a-47ef-99ec-1bc57896f9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:36.260828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae78329-8a8a-47ef-99ec-1bc57896f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:36.261186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae78329-8a8a-47ef-99ec-1bc57896f9b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:36.262035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae78329-8a8a-47ef-99ec-1bc57896f9b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:36.264165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae78329-8a8a-47ef-99ec-1bc57896f9b3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:36.285895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1127/2241] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:20:36 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:20:36.290157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865aa5e-a581-4f40-8cf3-63f37e03960b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:36.301260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865aa5e-a581-4f40-8cf3-63f37e03960b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:36.306096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24721e8e-92a5-43d6-b325-d6868479b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:36.306775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24721e8e-92a5-43d6-b325-d6868479b76c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:36.307056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24721e8e-92a5-43d6-b325-d6868479b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:36.307351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24721e8e-92a5-43d6-b325-d6868479b76c admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:36.308062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24721e8e-92a5-43d6-b325-d6868479b76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:36.309739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24721e8e-92a5-43d6-b325-d6868479b76c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:36.321255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1115/2242] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:36.325267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae78329-8a8a-47ef-99ec-1bc57896f9b3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:36.335515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae78329-8a8a-47ef-99ec-1bc57896f9b3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:36.340489 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c1923-a69a-4d82-af84-3a85d74db2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:36.341401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c1923-a69a-4d82-af84-3a85d74db2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:36.341678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c1923-a69a-4d82-af84-3a85d74db2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:36.342028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c1923-a69a-4d82-af84-3a85d74db2c2 admin admin] PATH_INFO: `/v3/projects/3fa80e9464a64bd0a976128a688416b8/users/1bbe4ed690db4e05bb52fdf78dc9a41a/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:36.357668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c1923-a69a-4d82-af84-3a85d74db2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa80e9464a64bd0a976128a688416b8, user_id=1bbe4ed690db4e05bb52fdf78dc9a41a, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:36.360747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c1923-a69a-4d82-af84-3a85d74db2c2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:36.380942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1128/2243] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:36 2022] PUT /identity/v3/projects/3fa80e9464a64bd0a976128a688416b8/users/1bbe4ed690db4e05bb52fdf78dc9a41a/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:36.385046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24721e8e-92a5-43d6-b325-d6868479b76c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:36.395110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24721e8e-92a5-43d6-b325-d6868479b76c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:36.488378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28006f21-8446-49d8-b8e9-60edbd43fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:36.489203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006f21-8446-49d8-b8e9-60edbd43fc37 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:36.489494 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006f21-8446-49d8-b8e9-60edbd43fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:36.490453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006f21-8446-49d8-b8e9-60edbd43fc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:36.490708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28006f21-8446-49d8-b8e9-60edbd43fc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:36.492532 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28006f21-8446-49d8-b8e9-60edbd43fc37 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:36.504631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1116/2244] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:20:36.508957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c1923-a69a-4d82-af84-3a85d74db2c2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:36.520543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c1923-a69a-4d82-af84-3a85d74db2c2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:36.525724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7f518-3222-4c7b-ac91-fff5a8c18317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:36.526620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7f518-3222-4c7b-ac91-fff5a8c18317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:36.527021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7f518-3222-4c7b-ac91-fff5a8c18317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:36.527301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7f518-3222-4c7b-ac91-fff5a8c18317 admin admin] PATH_INFO: `/v3/projects/3fa80e9464a64bd0a976128a688416b8/users/1bbe4ed690db4e05bb52fdf78dc9a41a/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:36.529618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7f518-3222-4c7b-ac91-fff5a8c18317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa80e9464a64bd0a976128a688416b8, user_id=1bbe4ed690db4e05bb52fdf78dc9a41a, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:36.537691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7f518-3222-4c7b-ac91-fff5a8c18317 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:36.550690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1129/2245] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:20:36 2022] PUT /identity/v3/projects/3fa80e9464a64bd0a976128a688416b8/users/1bbe4ed690db4e05bb52fdf78dc9a41a/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:39.465868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa506391-b886-49fc-99ea-d14ddf082ce2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:39.466867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa506391-b886-49fc-99ea-d14ddf082ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:39.467368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa506391-b886-49fc-99ea-d14ddf082ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:39.503033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fa506391-b886-49fc-99ea-d14ddf082ce2 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:39.504486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fa506391-b886-49fc-99ea-d14ddf082ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:39.692700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1117/2246] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:20:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:39.750065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7f518-3222-4c7b-ac91-fff5a8c18317 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:39.752014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a5b7f518-3222-4c7b-ac91-fff5a8c18317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:39.922416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7f518-3222-4c7b-ac91-fff5a8c18317 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:39.932250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c9b89-0641-48e5-bd57-06a8806a5daa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:39.933628 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c9b89-0641-48e5-bd57-06a8806a5daa service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:39.934079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c9b89-0641-48e5-bd57-06a8806a5daa service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:39.934505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c9b89-0641-48e5-bd57-06a8806a5daa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:39.944519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c9b89-0641-48e5-bd57-06a8806a5daa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:39.946711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c9b89-0641-48e5-bd57-06a8806a5daa service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:39.957647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1130/2247] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:20:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 09:20:41.193128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2710-a7d6-4a63-9380-8a8b527ce2ba None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:41.194033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2710-a7d6-4a63-9380-8a8b527ce2ba None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:41.194523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2710-a7d6-4a63-9380-8a8b527ce2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:41.239002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ccef2710-a7d6-4a63-9380-8a8b527ce2ba None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:41.247829 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ccef2710-a7d6-4a63-9380-8a8b527ce2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:41.269694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1118/2248] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jul 14 09:20:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:41.284947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c9b89-0641-48e5-bd57-06a8806a5daa service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:41.297594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c9b89-0641-48e5-bd57-06a8806a5daa service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:41.330513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab515db-216c-467b-810d-64f07429f58a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:41.331401 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab515db-216c-467b-810d-64f07429f58a service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:41.331778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab515db-216c-467b-810d-64f07429f58a service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:41.332301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab515db-216c-467b-810d-64f07429f58a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:41.351459 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab515db-216c-467b-810d-64f07429f58a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:41.353462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab515db-216c-467b-810d-64f07429f58a service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:41.406509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1131/2249] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:20:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:20:41.802081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f439-fed7-4371-bd3d-bc2a869cc927 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:41.802412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f439-fed7-4371-bd3d-bc2a869cc927 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:41.802692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f439-fed7-4371-bd3d-bc2a869cc927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:41.822714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4648f439-fed7-4371-bd3d-bc2a869cc927 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:41.824110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4648f439-fed7-4371-bd3d-bc2a869cc927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:41.833112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1119/2250] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:20:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:41.849280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab515db-216c-467b-810d-64f07429f58a service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:41.862492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab515db-216c-467b-810d-64f07429f58a service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:41.870076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806afee-ba05-4490-b331-3de78e9cfae9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:41.871028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806afee-ba05-4490-b331-3de78e9cfae9 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:41.871502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806afee-ba05-4490-b331-3de78e9cfae9 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:41.871975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806afee-ba05-4490-b331-3de78e9cfae9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:41.881848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806afee-ba05-4490-b331-3de78e9cfae9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:41.883721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806afee-ba05-4490-b331-3de78e9cfae9 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:41.894960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1132/2251] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:20:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:20:42.554618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e68867-6d19-4a72-bc94-22269c556104 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:42.555779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e68867-6d19-4a72-bc94-22269c556104 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:42.556950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e68867-6d19-4a72-bc94-22269c556104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:42.578844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-29e68867-6d19-4a72-bc94-22269c556104 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:42.580477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-29e68867-6d19-4a72-bc94-22269c556104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:42.589086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1120/2252] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jul 14 09:20:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:42.604262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806afee-ba05-4490-b331-3de78e9cfae9 service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:42.622063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806afee-ba05-4490-b331-3de78e9cfae9 service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:42.629465 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c14d05-151b-412e-a99f-4ef9e38de8a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:42.631018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c14d05-151b-412e-a99f-4ef9e38de8a5 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:42.631746 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c14d05-151b-412e-a99f-4ef9e38de8a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:42.632245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c14d05-151b-412e-a99f-4ef9e38de8a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:42.645253 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c14d05-151b-412e-a99f-4ef9e38de8a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:42.648313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c14d05-151b-412e-a99f-4ef9e38de8a5 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:42.661372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1133/2253] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:20:43.689536 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642a4fc-8b60-4490-890b-a8352aba47fd None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:43.690131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642a4fc-8b60-4490-890b-a8352aba47fd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:43.690131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642a4fc-8b60-4490-890b-a8352aba47fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:43.719682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7642a4fc-8b60-4490-890b-a8352aba47fd None None] MFA Rules not processed for user `f354a75ed51144769da1db0ec92e7980`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:43.721280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7642a4fc-8b60-4490-890b-a8352aba47fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:43.732480 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:43.900707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1121/2254] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:44.470815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e7786-51b5-47cb-9323-cbc9c818191c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:44.472602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e7786-51b5-47cb-9323-cbc9c818191c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:44.473153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e7786-51b5-47cb-9323-cbc9c818191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:44.508307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-470e7786-51b5-47cb-9323-cbc9c818191c None None] MFA Rules not processed for user `5ba9be3543884f02bd15c95b0dbbe644`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:44.513435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-470e7786-51b5-47cb-9323-cbc9c818191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:44.666001 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:44.691737 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1134/2255] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:45.022321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3d2b7-f623-4332-a636-21d2411a3e5f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:45.024028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3d2b7-f623-4332-a636-21d2411a3e5f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:45.024509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3d2b7-f623-4332-a636-21d2411a3e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:45.057728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2aa3d2b7-f623-4332-a636-21d2411a3e5f None None] MFA Rules not processed for user `1bbe4ed690db4e05bb52fdf78dc9a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:45.058444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba2c4-e557-4cdc-9ecd-223ab3b9879d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:45.058748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba2c4-e557-4cdc-9ecd-223ab3b9879d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:45.059034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba2c4-e557-4cdc-9ecd-223ab3b9879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:45.059178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2aa3d2b7-f623-4332-a636-21d2411a3e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:45.079228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-710ba2c4-e557-4cdc-9ecd-223ab3b9879d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:45.080894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-710ba2c4-e557-4cdc-9ecd-223ab3b9879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:45.137130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1122/2256] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:20:45.152061 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3d2b7-f623-4332-a636-21d2411a3e5f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:45.153961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2aa3d2b7-f623-4332-a636-21d2411a3e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:45.194716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1135/2257] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:45.264131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3d2b7-f623-4332-a636-21d2411a3e5f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:45.269768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e966391-6136-496d-82e3-1c9068d1429d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf4ab9d717e4c838d68590336074f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:45.270544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e966391-6136-496d-82e3-1c9068d1429d service glance] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:45.270897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e966391-6136-496d-82e3-1c9068d1429d service glance] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:45.271266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e966391-6136-496d-82e3-1c9068d1429d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:45.373871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:45.374226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba2c4-e557-4cdc-9ecd-223ab3b9879d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:45.376116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-710ba2c4-e557-4cdc-9ecd-223ab3b9879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:45.382884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e966391-6136-496d-82e3-1c9068d1429d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:45.384410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e966391-6136-496d-82e3-1c9068d1429d service glance] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:45.398959 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1123/2258] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:20:45.399196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba2c4-e557-4cdc-9ecd-223ab3b9879d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:45.412695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:45.413844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:45.414262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:45.414709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] PATH_INFO: `/v3/users/1b62d69933b14a789f35bfe0570b3650` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:45.418684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b62d69933b14a789f35bfe0570b3650)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:45.423812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:45.562356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b62d69933b14a789f35bfe0570b3650'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:45.574550 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055ded9-1bea-48bf-a1b3-5915146bc0eb None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:45.575087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055ded9-1bea-48bf-a1b3-5915146bc0eb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:45.575516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055ded9-1bea-48bf-a1b3-5915146bc0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:45.584350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b62d69933b14a789f35bfe0570b3650'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:45.587501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b62d69933b14a789f35bfe0570b3650'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:45.603146 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2055ded9-1bea-48bf-a1b3-5915146bc0eb None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:45.604589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2055ded9-1bea-48bf-a1b3-5915146bc0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:45.614951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b62d69933b14a789f35bfe0570b3650'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:45.616097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7a7c084-850c-4599-b62c-e9b9f26100f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b62d69933b14a789f35bfe0570b3650'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:45.624437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1124/2259] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:20:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:20:45.638963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055ded9-1bea-48bf-a1b3-5915146bc0eb None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:45.641004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2055ded9-1bea-48bf-a1b3-5915146bc0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:45.658717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1136/2260] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:20:45 2022] DELETE /identity/v3/users/1b62d69933b14a789f35bfe0570b3650 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:20:45.661338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65301adc-d13c-494c-8f2e-99b755db1090 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:45.661854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65301adc-d13c-494c-8f2e-99b755db1090 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:45.662413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65301adc-d13c-494c-8f2e-99b755db1090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:45.665317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055ded9-1bea-48bf-a1b3-5915146bc0eb None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:45.756407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-65301adc-d13c-494c-8f2e-99b755db1090 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:45.763317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-65301adc-d13c-494c-8f2e-99b755db1090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:45.817717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17c550-1049-4eb7-90ad-6a681cc779cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:45.818964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17c550-1049-4eb7-90ad-6a681cc779cb service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:45.819429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17c550-1049-4eb7-90ad-6a681cc779cb service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:45.819861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17c550-1049-4eb7-90ad-6a681cc779cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:45.869981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1137/2261] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:45.871462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65301adc-d13c-494c-8f2e-99b755db1090 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:45.884079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-65301adc-d13c-494c-8f2e-99b755db1090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:45.914531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:45.969711 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17c550-1049-4eb7-90ad-6a681cc779cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:45.971529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17c550-1049-4eb7-90ad-6a681cc779cb service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:45.996974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1125/2262] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:20:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 09:20:45.998154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17c550-1049-4eb7-90ad-6a681cc779cb service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:46.000824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1e17c550-1049-4eb7-90ad-6a681cc779cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:46.068232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65301adc-d13c-494c-8f2e-99b755db1090 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:46.077262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd69165-a672-4ead-919c-4fc67d6ab3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:46.078337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd69165-a672-4ead-919c-4fc67d6ab3ff service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:46.078789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd69165-a672-4ead-919c-4fc67d6ab3ff service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:46.079259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd69165-a672-4ead-919c-4fc67d6ab3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:46.081587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bcd69165-a672-4ead-919c-4fc67d6ab3ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:46.136915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd69165-a672-4ead-919c-4fc67d6ab3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:46.138804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd69165-a672-4ead-919c-4fc67d6ab3ff service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:46.141378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17c550-1049-4eb7-90ad-6a681cc779cb service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:46.155780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d172e-ebf6-4fe8-91ac-291017c82956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:46.156922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d172e-ebf6-4fe8-91ac-291017c82956 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:46.157083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d172e-ebf6-4fe8-91ac-291017c82956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:46.157342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d172e-ebf6-4fe8-91ac-291017c82956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:46.179130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1138/2263] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:46.184114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d172e-ebf6-4fe8-91ac-291017c82956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:46.185633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d172e-ebf6-4fe8-91ac-291017c82956 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:46.201757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1126/2264] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:46.502667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd69165-a672-4ead-919c-4fc67d6ab3ff service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:46.504689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bcd69165-a672-4ead-919c-4fc67d6ab3ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:46.526701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd69165-a672-4ead-919c-4fc67d6ab3ff service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:46.553100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:46.554657 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:46.555234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:46.555822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] PATH_INFO: `/v3/projects/290e9bd74e5e4d36a41e7874f952389b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:46.559256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290e9bd74e5e4d36a41e7874f952389b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:46.561986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:46.665030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290e9bd74e5e4d36a41e7874f952389b', 'request_id': 'req-e5f1f342-4db4-4af7-9a14-cc21b017ea51'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:46.679314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290e9bd74e5e4d36a41e7874f952389b', 'request_id': 'req-e5f1f342-4db4-4af7-9a14-cc21b017ea51'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:46.693407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290e9bd74e5e4d36a41e7874f952389b', 'request_id': 'req-e5f1f342-4db4-4af7-9a14-cc21b017ea51'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:46.717581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] The token cache is being invalidate because project 290e9bd74e5e4d36a41e7874f952389b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:20:46.718022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:46.719124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:20:46.721560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1139/2265] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:20:46 2022] DELETE /identity/v3/projects/290e9bd74e5e4d36a41e7874f952389b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:20:50.516211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2d296-b964-4b27-8aab-e52f278e2d36 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:50.517019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2d296-b964-4b27-8aab-e52f278e2d36 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:50.517019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2d296-b964-4b27-8aab-e52f278e2d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:50.591690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-cfb2d296-b964-4b27-8aab-e52f278e2d36 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:50.627560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cfb2d296-b964-4b27-8aab-e52f278e2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:50.633240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:50.701889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1127/2266] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:50.744025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:50.746499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:50.874184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1f342-4db4-4af7-9a14-cc21b017ea51 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:50.881843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2dc25-0d19-49e6-9d05-af16349d63fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:50.882685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2dc25-0d19-49e6-9d05-af16349d63fc service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:50.883119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2dc25-0d19-49e6-9d05-af16349d63fc service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:50.883487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2dc25-0d19-49e6-9d05-af16349d63fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:50.895260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2dc25-0d19-49e6-9d05-af16349d63fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:50.897832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2dc25-0d19-49e6-9d05-af16349d63fc service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:50.910510 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1140/2267] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:20:55.179383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daad4-3367-413c-a097-aa42e14a888e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:55.180590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daad4-3367-413c-a097-aa42e14a888e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:55.181261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daad4-3367-413c-a097-aa42e14a888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:55.209149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fb0daad4-3367-413c-a097-aa42e14a888e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:55.210542 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb0daad4-3367-413c-a097-aa42e14a888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:55.222355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1128/2268] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:20:55.255805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2dc25-0d19-49e6-9d05-af16349d63fc service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:20:55.257447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0fa2dc25-0d19-49e6-9d05-af16349d63fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:55.267503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:20:55.277779 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2dc25-0d19-49e6-9d05-af16349d63fc service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:20:55.287409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cffe79-6789-40d5-a883-835d5c0c0b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:20:55.288369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cffe79-6789-40d5-a883-835d5c0c0b7f service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:55.288807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cffe79-6789-40d5-a883-835d5c0c0b7f service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:55.289175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cffe79-6789-40d5-a883-835d5c0c0b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:55.301719 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cffe79-6789-40d5-a883-835d5c0c0b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:20:55.306374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cffe79-6789-40d5-a883-835d5c0c0b7f service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:20:55.325014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1141/2269] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:20:58.707861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8b32-e9a6-47c4-87ee-8077375ff6fb None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:20:58.708483 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8b32-e9a6-47c4-87ee-8077375ff6fb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:20:58.708483 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8b32-e9a6-47c4-87ee-8077375ff6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:20:58.727155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-08fe8b32-e9a6-47c4-87ee-8077375ff6fb None None] MFA Rules not processed for user `59941fa402854b44a5b7feebdbd2c5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:20:58.728370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-08fe8b32-e9a6-47c4-87ee-8077375ff6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:20:58.790890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1129/2270] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:20:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:21:00.286341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e1c2-6f03-4868-9784-2596f1721860 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:00.286869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e1c2-6f03-4868-9784-2596f1721860 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:00.286965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e1c2-6f03-4868-9784-2596f1721860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:00.306538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6c21e1c2-6f03-4868-9784-2596f1721860 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:00.307774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6c21e1c2-6f03-4868-9784-2596f1721860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:00.316411 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1142/2271] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:21:00.348739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe8b32-e9a6-47c4-87ee-8077375ff6fb None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:00.364605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe8b32-e9a6-47c4-87ee-8077375ff6fb None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:00.371359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511ac7d-1144-4007-9266-4f90fb1195ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:00.372053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511ac7d-1144-4007-9266-4f90fb1195ad service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:00.372333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511ac7d-1144-4007-9266-4f90fb1195ad service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:00.372601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511ac7d-1144-4007-9266-4f90fb1195ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:00.382481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511ac7d-1144-4007-9266-4f90fb1195ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:00.384113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511ac7d-1144-4007-9266-4f90fb1195ad service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:00.394220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1130/2272] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:21:04.591928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca204a-1732-46b3-9a4d-b38a64b3b2c6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:04.592448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca204a-1732-46b3-9a4d-b38a64b3b2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:04.592574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca204a-1732-46b3-9a4d-b38a64b3b2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:04.634364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-98ca204a-1732-46b3-9a4d-b38a64b3b2c6 None None] MFA Rules not processed for user `d2b2f1b8064945e4834be2050db26867`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:04.657193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-98ca204a-1732-46b3-9a4d-b38a64b3b2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:04.759502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1143/2273] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:21:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:21:05.559642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae6d1c-ed70-4f30-8998-a82fb1fff69f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:05.560701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae6d1c-ed70-4f30-8998-a82fb1fff69f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:05.561267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae6d1c-ed70-4f30-8998-a82fb1fff69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:05.588228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5cae6d1c-ed70-4f30-8998-a82fb1fff69f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:05.590307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5cae6d1c-ed70-4f30-8998-a82fb1fff69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:05.601766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1131/2274] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:21:06.167083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca204a-1732-46b3-9a4d-b38a64b3b2c6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:06.181479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca204a-1732-46b3-9a4d-b38a64b3b2c6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:06.189093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925888ae-06d1-4881-8d2e-b22453ca4cfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:06.189817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925888ae-06d1-4881-8d2e-b22453ca4cfd service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:06.190124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925888ae-06d1-4881-8d2e-b22453ca4cfd service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:06.190435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925888ae-06d1-4881-8d2e-b22453ca4cfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:06.202095 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925888ae-06d1-4881-8d2e-b22453ca4cfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:06.204976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925888ae-06d1-4881-8d2e-b22453ca4cfd service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:06.227659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1144/2275] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:21:06.903424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e1f08-eac0-4791-97c5-cf92ab718c8a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:06.903965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e1f08-eac0-4791-97c5-cf92ab718c8a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:06.904217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e1f08-eac0-4791-97c5-cf92ab718c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:06.923092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-746e1f08-eac0-4791-97c5-cf92ab718c8a None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:06.924324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-746e1f08-eac0-4791-97c5-cf92ab718c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:07.029793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1132/2276] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:21:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:21:07.052350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925888ae-06d1-4881-8d2e-b22453ca4cfd service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:07.054174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-925888ae-06d1-4881-8d2e-b22453ca4cfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:07.150632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925888ae-06d1-4881-8d2e-b22453ca4cfd service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:07.156356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4d2ea-f5f0-4b54-bc46-dd8f91186735 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:07.157092 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4d2ea-f5f0-4b54-bc46-dd8f91186735 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:07.157590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4d2ea-f5f0-4b54-bc46-dd8f91186735 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:07.157899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4d2ea-f5f0-4b54-bc46-dd8f91186735 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:07.169603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4d2ea-f5f0-4b54-bc46-dd8f91186735 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:07.172116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4d2ea-f5f0-4b54-bc46-dd8f91186735 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:07.184308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1145/2277] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:21:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:21:17.019385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=75 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:21:17.178413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=71 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:21:25.798360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf88e4d-da90-4e8a-85e3-444cf1636a98 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:25.799485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf88e4d-da90-4e8a-85e3-444cf1636a98 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:25.799951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf88e4d-da90-4e8a-85e3-444cf1636a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:25.826901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2bf88e4d-da90-4e8a-85e3-444cf1636a98 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:25.828525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2bf88e4d-da90-4e8a-85e3-444cf1636a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:25.838103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1133/2278] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:21:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:21:25.854827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4d2ea-f5f0-4b54-bc46-dd8f91186735 service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:25.873881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4d2ea-f5f0-4b54-bc46-dd8f91186735 service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:25.888018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885ef9a-fbb8-4db6-8737-ff371a554393 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:25.888018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885ef9a-fbb8-4db6-8737-ff371a554393 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:25.888018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885ef9a-fbb8-4db6-8737-ff371a554393 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:25.888018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885ef9a-fbb8-4db6-8737-ff371a554393 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:25.900223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885ef9a-fbb8-4db6-8737-ff371a554393 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:25.902009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885ef9a-fbb8-4db6-8737-ff371a554393 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:25.913551 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1146/2279] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:21:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 09:21:26.385529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a00ed-e917-46e6-9d99-5ad09dfcc0a3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:26.386486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a00ed-e917-46e6-9d99-5ad09dfcc0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:26.386927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a00ed-e917-46e6-9d99-5ad09dfcc0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:26.440030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d94a00ed-e917-46e6-9d99-5ad09dfcc0a3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:26.442735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d94a00ed-e917-46e6-9d99-5ad09dfcc0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:26.483508 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1134/2280] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:21:26.506167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885ef9a-fbb8-4db6-8737-ff371a554393 service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:26.534905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885ef9a-fbb8-4db6-8737-ff371a554393 service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:26.552217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401402fb-215f-4b5a-a47d-0a456683f7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:26.553896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401402fb-215f-4b5a-a47d-0a456683f7e4 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:26.554335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401402fb-215f-4b5a-a47d-0a456683f7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:26.554762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401402fb-215f-4b5a-a47d-0a456683f7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:26.568248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401402fb-215f-4b5a-a47d-0a456683f7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:26.570409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401402fb-215f-4b5a-a47d-0a456683f7e4 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:26.605596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1147/2281] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:21:29.024197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1857-927c-40a6-83cd-9e7ca1d563d9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:29.025165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1857-927c-40a6-83cd-9e7ca1d563d9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:29.025650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1857-927c-40a6-83cd-9e7ca1d563d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:29.050319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-343c1857-927c-40a6-83cd-9e7ca1d563d9 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:29.051548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-343c1857-927c-40a6-83cd-9e7ca1d563d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:29.060161 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1135/2282] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:21:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:21:29.082617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401402fb-215f-4b5a-a47d-0a456683f7e4 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:29.097757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401402fb-215f-4b5a-a47d-0a456683f7e4 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:29.103425 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b0b8a-1040-45a6-b922-a8bdb1ddd42a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:29.104187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b0b8a-1040-45a6-b922-a8bdb1ddd42a service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:29.104603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b0b8a-1040-45a6-b922-a8bdb1ddd42a service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:29.104924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b0b8a-1040-45a6-b922-a8bdb1ddd42a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:29.118500 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b0b8a-1040-45a6-b922-a8bdb1ddd42a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:29.120135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b0b8a-1040-45a6-b922-a8bdb1ddd42a service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:29.134042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1148/2283] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:21:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 09:21:39.044410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=9 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:21:39.125233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=18 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:21:45.547725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c1857-927c-40a6-83cd-9e7ca1d563d9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:45.550612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-343c1857-927c-40a6-83cd-9e7ca1d563d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:45.874523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c1857-927c-40a6-83cd-9e7ca1d563d9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:45.893349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb5e77-f1a9-4bfb-accc-078b5797dfb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:45.895331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb5e77-f1a9-4bfb-accc-078b5797dfb2 service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:45.896226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb5e77-f1a9-4bfb-accc-078b5797dfb2 service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:45.897567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb5e77-f1a9-4bfb-accc-078b5797dfb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:45.909543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-10fb5e77-f1a9-4bfb-accc-078b5797dfb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:45.954921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb5e77-f1a9-4bfb-accc-078b5797dfb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:45.958437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb5e77-f1a9-4bfb-accc-078b5797dfb2 service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:45.980565 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1136/2284] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:21:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:21:49.076342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbf102-c795-4167-b2b8-169becbc3249 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:49.077320 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbf102-c795-4167-b2b8-169becbc3249 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:49.077752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbf102-c795-4167-b2b8-169becbc3249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:49.097820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c5bbf102-c795-4167-b2b8-169becbc3249 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:49.099961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c5bbf102-c795-4167-b2b8-169becbc3249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:49.110894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1149/2285] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jul 14 09:21:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:21:49.123453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb5e77-f1a9-4bfb-accc-078b5797dfb2 service placement] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:49.135420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb5e77-f1a9-4bfb-accc-078b5797dfb2 service placement] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:49.141479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58965f-0ea5-4879-a6e1-ea1c1cc23cbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:49.142128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58965f-0ea5-4879-a6e1-ea1c1cc23cbd service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:49.142409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58965f-0ea5-4879-a6e1-ea1c1cc23cbd service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:49.142683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58965f-0ea5-4879-a6e1-ea1c1cc23cbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:49.151544 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58965f-0ea5-4879-a6e1-ea1c1cc23cbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:49.153255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58965f-0ea5-4879-a6e1-ea1c1cc23cbd service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:49.162415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1137/2286] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:21:50.660036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbf102-c795-4167-b2b8-169becbc3249 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:50.661681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c5bbf102-c795-4167-b2b8-169becbc3249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:50.722135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbf102-c795-4167-b2b8-169becbc3249 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:50.726361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e32fc-6220-4126-b8ee-9e8e8e303301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:50.727370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e32fc-6220-4126-b8ee-9e8e8e303301 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:50.727709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e32fc-6220-4126-b8ee-9e8e8e303301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:50.727982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e32fc-6220-4126-b8ee-9e8e8e303301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:50.731245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1d0e32fc-6220-4126-b8ee-9e8e8e303301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:50.803249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e32fc-6220-4126-b8ee-9e8e8e303301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:50.805071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e32fc-6220-4126-b8ee-9e8e8e303301 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:50.817190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1150/2287] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:21:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:21:51.421950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58965f-0ea5-4879-a6e1-ea1c1cc23cbd service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:51.423525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4d58965f-0ea5-4879-a6e1-ea1c1cc23cbd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:51.449817 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58965f-0ea5-4879-a6e1-ea1c1cc23cbd service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:51.455453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:51.456420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:51.456834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:51.457205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] PATH_INFO: `/v3/users/5ba9be3543884f02bd15c95b0dbbe644` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:51.458581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba9be3543884f02bd15c95b0dbbe644)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:51.460782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:51.542322 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba9be3543884f02bd15c95b0dbbe644'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:21:51.547062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba9be3543884f02bd15c95b0dbbe644'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:21:51.552766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba9be3543884f02bd15c95b0dbbe644'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:21:51.563270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba9be3543884f02bd15c95b0dbbe644'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:21:51.564316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3ea1f459-285b-4f9a-b77f-cf3a19269fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba9be3543884f02bd15c95b0dbbe644'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:21:51.592596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1138/2288] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:21:51 2022] DELETE /identity/v3/users/5ba9be3543884f02bd15c95b0dbbe644 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:21:51.639188 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a66d-d17e-4611-81a1-de1f2c30620e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:51.639656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a66d-d17e-4611-81a1-de1f2c30620e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:51.640374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a66d-d17e-4611-81a1-de1f2c30620e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:51.643098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1151/2289] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:21:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:21:51.650042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459b11d-9ec1-410a-9144-d77347288bb0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:51.650800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459b11d-9ec1-410a-9144-d77347288bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:51.650800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459b11d-9ec1-410a-9144-d77347288bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:51.679619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e459b11d-9ec1-410a-9144-d77347288bb0 None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:51.682844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e459b11d-9ec1-410a-9144-d77347288bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:51.747670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:21:51.776539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1139/2290] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:21:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:21:51.790130 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9a66d-d17e-4611-81a1-de1f2c30620e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:51.792289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-19e9a66d-d17e-4611-81a1-de1f2c30620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:51.859689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9a66d-d17e-4611-81a1-de1f2c30620e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:51.863464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98553f1c-4d03-434c-9c19-8d89a0906ae7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf4ab9d717e4c838d68590336074f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:51.864215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98553f1c-4d03-434c-9c19-8d89a0906ae7 service glance] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:51.864560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98553f1c-4d03-434c-9c19-8d89a0906ae7 service glance] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:51.864874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98553f1c-4d03-434c-9c19-8d89a0906ae7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:51.876220 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98553f1c-4d03-434c-9c19-8d89a0906ae7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:51.877703 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98553f1c-4d03-434c-9c19-8d89a0906ae7 service glance] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:51.889686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1152/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:21:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:21:51.956404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459b11d-9ec1-410a-9144-d77347288bb0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:51.958106 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e459b11d-9ec1-410a-9144-d77347288bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:51.962622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bfca-b067-47b5-a09f-0f18f24db4f7 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:51.963046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bfca-b067-47b5-a09f-0f18f24db4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:51.963507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bfca-b067-47b5-a09f-0f18f24db4f7 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:51.965973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1153/2292] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:21:51.971150 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7499264-e83e-4b81-bad9-b1da83dbfa7f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:51.971513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7499264-e83e-4b81-bad9-b1da83dbfa7f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:51.971858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7499264-e83e-4b81-bad9-b1da83dbfa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:51.990725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f7499264-e83e-4b81-bad9-b1da83dbfa7f None None] MFA Rules not processed for user `60db5d8bc4cb4ce7af8bfac2c4eb2390`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:51.992012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f7499264-e83e-4b81-bad9-b1da83dbfa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:52.046908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459b11d-9ec1-410a-9144-d77347288bb0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:52.049625 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:21:52.053619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:52.054558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:52.054832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:52.055107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] PATH_INFO: `/v3/projects/b545bb60674745b8a2d06663e9cff90a` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:52.056437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b545bb60674745b8a2d06663e9cff90a)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:52.058528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:52.065223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1154/2293] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:21:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:21:52.082310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7499264-e83e-4b81-bad9-b1da83dbfa7f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:52.084611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f7499264-e83e-4b81-bad9-b1da83dbfa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:52.098379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7499264-e83e-4b81-bad9-b1da83dbfa7f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:52.102348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc0c5f-3565-443e-b606-1eb5bb654687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:52.103050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc0c5f-3565-443e-b606-1eb5bb654687 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:52.103342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc0c5f-3565-443e-b606-1eb5bb654687 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:52.103772 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc0c5f-3565-443e-b606-1eb5bb654687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:52.113579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc0c5f-3565-443e-b606-1eb5bb654687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:52.115051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc0c5f-3565-443e-b606-1eb5bb654687 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:52.118175 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b545bb60674745b8a2d06663e9cff90a', 'request_id': 'req-2cefd8e0-e965-4d6a-b065-08325f0385ac'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:21:52.123661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1155/2294] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:21:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:21:52.128330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b545bb60674745b8a2d06663e9cff90a', 'request_id': 'req-2cefd8e0-e965-4d6a-b065-08325f0385ac'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:21:52.136248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b545bb60674745b8a2d06663e9cff90a', 'request_id': 'req-2cefd8e0-e965-4d6a-b065-08325f0385ac'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:21:52.149280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] The token cache is being invalidate because project b545bb60674745b8a2d06663e9cff90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:21:52.149653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:21:52.150360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2cefd8e0-e965-4d6a-b065-08325f0385ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:21:52.152041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1140/2295] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:21:51 2022] DELETE /identity/v3/projects/b545bb60674745b8a2d06663e9cff90a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:21:52.238735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fc888-a3f5-4401-ac7e-bbb53cf0bde8 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:52.239032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fc888-a3f5-4401-ac7e-bbb53cf0bde8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:52.239316 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fc888-a3f5-4401-ac7e-bbb53cf0bde8 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:52.241026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1156/2296] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:21:52.249036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845fc4d-dcd9-41c6-afad-f84ba3c1c25b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:52.250211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845fc4d-dcd9-41c6-afad-f84ba3c1c25b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:52.250608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845fc4d-dcd9-41c6-afad-f84ba3c1c25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:52.274125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a845fc4d-dcd9-41c6-afad-f84ba3c1c25b None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:52.275487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a845fc4d-dcd9-41c6-afad-f84ba3c1c25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:52.364569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1141/2297] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:21:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:21:52.371809 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fc888-a3f5-4401-ac7e-bbb53cf0bde8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:52.373977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-980fc888-a3f5-4401-ac7e-bbb53cf0bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:52.439774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fc888-a3f5-4401-ac7e-bbb53cf0bde8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:52.443991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d633d-6722-4c04-ba46-a427601778df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:52.444313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d633d-6722-4c04-ba46-a427601778df service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:52.444603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d633d-6722-4c04-ba46-a427601778df service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:52.444952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d633d-6722-4c04-ba46-a427601778df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:52.458748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d633d-6722-4c04-ba46-a427601778df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:52.460698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d633d-6722-4c04-ba46-a427601778df service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:52.473201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1157/2298] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:21:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:21:53.813427 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692896f-0e6a-4d22-a4ae-4774bea8c169 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:53.814419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692896f-0e6a-4d22-a4ae-4774bea8c169 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:53.814696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692896f-0e6a-4d22-a4ae-4774bea8c169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:53.821428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:21:53.845534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5692896f-0e6a-4d22-a4ae-4774bea8c169 None None] MFA Rules not processed for user `dd68e291b36347d29b568e3a24f53242`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:53.847001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5692896f-0e6a-4d22-a4ae-4774bea8c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:53.918477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1142/2299] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:21:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:21:55.817049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f2c7-6488-48bb-abf8-436132a29cc0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:55.817574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f2c7-6488-48bb-abf8-436132a29cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:55.817825 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f2c7-6488-48bb-abf8-436132a29cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:55.839015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4515f2c7-6488-48bb-abf8-436132a29cc0 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:21:55.840655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4515f2c7-6488-48bb-abf8-436132a29cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:55.931877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1158/2300] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:21:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:21:55.947727 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692896f-0e6a-4d22-a4ae-4774bea8c169 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:21:55.950464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5692896f-0e6a-4d22-a4ae-4774bea8c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:21:56.029828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692896f-0e6a-4d22-a4ae-4774bea8c169 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:21:56.034945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ab6fd-376e-477c-acd2-79797aa9cba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:21:56.035610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab6fd-376e-477c-acd2-79797aa9cba8 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:21:56.035898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab6fd-376e-477c-acd2-79797aa9cba8 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:21:56.036172 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab6fd-376e-477c-acd2-79797aa9cba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:21:56.044887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ab6fd-376e-477c-acd2-79797aa9cba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:21:56.046519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ab6fd-376e-477c-acd2-79797aa9cba8 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:21:56.059275 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1143/2301] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:21:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:22:05.924221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=59 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:22:06.056070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=56 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:22:19.025567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995586-66b2-4c55-9b27-85fde19de068 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:19.026203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995586-66b2-4c55-9b27-85fde19de068 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:19.026203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995586-66b2-4c55-9b27-85fde19de068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:19.044341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-41995586-66b2-4c55-9b27-85fde19de068 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:22:19.045587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-41995586-66b2-4c55-9b27-85fde19de068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:22:19.053685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1159/2302] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jul 14 09:22:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:22:19.066246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ab6fd-376e-477c-acd2-79797aa9cba8 service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:22:19.088912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ab6fd-376e-477c-acd2-79797aa9cba8 service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:22:19.094685 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfda2d-8f26-4caa-9106-b48fc9994dc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:22:19.095337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfda2d-8f26-4caa-9106-b48fc9994dc7 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:19.095617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfda2d-8f26-4caa-9106-b48fc9994dc7 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:19.095911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfda2d-8f26-4caa-9106-b48fc9994dc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:19.104699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfda2d-8f26-4caa-9106-b48fc9994dc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:22:19.110265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfda2d-8f26-4caa-9106-b48fc9994dc7 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:22:19.116768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1144/2303] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:22:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:22:25.369796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7c0df-85af-49d7-8fbd-2c34bfa6a4cc None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:25.370317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7c0df-85af-49d7-8fbd-2c34bfa6a4cc None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:25.370429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7c0df-85af-49d7-8fbd-2c34bfa6a4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:25.370879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b25a6-d2f8-4e91-b8b6-6f7b66b1978f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:25.371266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b25a6-d2f8-4e91-b8b6-6f7b66b1978f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:25.371450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b25a6-d2f8-4e91-b8b6-6f7b66b1978f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:25.390391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-aa3b25a6-d2f8-4e91-b8b6-6f7b66b1978f None None] MFA Rules not processed for user `f354a75ed51144769da1db0ec92e7980`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:22:25.392063 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-aa3b25a6-d2f8-4e91-b8b6-6f7b66b1978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:22:25.398676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-faf7c0df-85af-49d7-8fbd-2c34bfa6a4cc None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:22:25.399893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-faf7c0df-85af-49d7-8fbd-2c34bfa6a4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:22:25.453109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1145/2304] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:22:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:22:25.473705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1160/2305] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:22:25.501439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b25a6-d2f8-4e91-b8b6-6f7b66b1978f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:22:25.502986 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-aa3b25a6-d2f8-4e91-b8b6-6f7b66b1978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:22:25.521187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b25a6-d2f8-4e91-b8b6-6f7b66b1978f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:22:25.526838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecced3-695a-48b5-b3f1-e46a27598ab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:22:25.527505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecced3-695a-48b5-b3f1-e46a27598ab0 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:25.527801 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecced3-695a-48b5-b3f1-e46a27598ab0 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:25.528082 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecced3-695a-48b5-b3f1-e46a27598ab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:25.537369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecced3-695a-48b5-b3f1-e46a27598ab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:22:25.538980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecced3-695a-48b5-b3f1-e46a27598ab0 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:22:25.549386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1146/2306] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:22:28.667317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2bca1-a4f0-496b-ad25-41924f09ca5a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:28.667925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2bca1-a4f0-496b-ad25-41924f09ca5a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:28.670243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2bca1-a4f0-496b-ad25-41924f09ca5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:28.715960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c1d2bca1-a4f0-496b-ad25-41924f09ca5a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:22:28.717837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c1d2bca1-a4f0-496b-ad25-41924f09ca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:22:28.734583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1161/2307] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:22:28.762446 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecced3-695a-48b5-b3f1-e46a27598ab0 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:22:28.776573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecced3-695a-48b5-b3f1-e46a27598ab0 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:22:28.783820 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602f2e2-4d0b-4b01-9a74-1313f10a7df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:22:28.784752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602f2e2-4d0b-4b01-9a74-1313f10a7df2 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:28.785218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602f2e2-4d0b-4b01-9a74-1313f10a7df2 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:28.786274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602f2e2-4d0b-4b01-9a74-1313f10a7df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:28.796607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602f2e2-4d0b-4b01-9a74-1313f10a7df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:22:28.799184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602f2e2-4d0b-4b01-9a74-1313f10a7df2 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:22:28.809051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1147/2308] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:22:32.775581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feb4bf-da00-4ccc-b0dd-3017b5399481 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:32.776494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feb4bf-da00-4ccc-b0dd-3017b5399481 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:32.776494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feb4bf-da00-4ccc-b0dd-3017b5399481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:32.797299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-65feb4bf-da00-4ccc-b0dd-3017b5399481 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:22:32.798569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-65feb4bf-da00-4ccc-b0dd-3017b5399481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:22:32.808363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1162/2309] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:22:32.834669 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602f2e2-4d0b-4b01-9a74-1313f10a7df2 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:22:32.846625 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602f2e2-4d0b-4b01-9a74-1313f10a7df2 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:22:32.855701 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6837-b9e5-4f37-8531-c893c8c65cca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:22:32.856720 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6837-b9e5-4f37-8531-c893c8c65cca service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:32.857053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6837-b9e5-4f37-8531-c893c8c65cca service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:32.857415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6837-b9e5-4f37-8531-c893c8c65cca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:32.867612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f6837-b9e5-4f37-8531-c893c8c65cca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:22:32.869263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f6837-b9e5-4f37-8531-c893c8c65cca service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:22:32.880304 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1148/2310] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:22:36.997526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74dfa-6beb-41ba-889e-96367f8b6102 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:36.999007 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74dfa-6beb-41ba-889e-96367f8b6102 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:36.999525 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74dfa-6beb-41ba-889e-96367f8b6102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:37.027543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-39f74dfa-6beb-41ba-889e-96367f8b6102 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:22:37.028818 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-39f74dfa-6beb-41ba-889e-96367f8b6102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:22:37.038051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1163/2311] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:22:37.088484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6837-b9e5-4f37-8531-c893c8c65cca service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:22:37.102130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6837-b9e5-4f37-8531-c893c8c65cca service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:22:37.109179 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d127114-92f0-4b85-86f6-f2b8deab6baf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:22:37.109950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d127114-92f0-4b85-86f6-f2b8deab6baf service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:37.110314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d127114-92f0-4b85-86f6-f2b8deab6baf service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:37.110661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d127114-92f0-4b85-86f6-f2b8deab6baf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:37.122182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d127114-92f0-4b85-86f6-f2b8deab6baf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:22:37.123793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d127114-92f0-4b85-86f6-f2b8deab6baf service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:22:37.134581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1149/2312] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:22:42.224161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf1c36-0ed2-4d12-b741-862610c31c25 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:42.225056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf1c36-0ed2-4d12-b741-862610c31c25 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:42.225479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf1c36-0ed2-4d12-b741-862610c31c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:42.245534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-73bf1c36-0ed2-4d12-b741-862610c31c25 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:22:42.246987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-73bf1c36-0ed2-4d12-b741-862610c31c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:22:42.258405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1164/2313] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 14 09:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:22:42.281444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d127114-92f0-4b85-86f6-f2b8deab6baf service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:22:42.283063 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9d127114-92f0-4b85-86f6-f2b8deab6baf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:22:42.300039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d127114-92f0-4b85-86f6-f2b8deab6baf service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:22:42.306274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96feda-4c26-4a1b-9fd5-57366aa86a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:22:42.306945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96feda-4c26-4a1b-9fd5-57366aa86a91 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:22:42.307231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96feda-4c26-4a1b-9fd5-57366aa86a91 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:22:42.307518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96feda-4c26-4a1b-9fd5-57366aa86a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:22:42.316779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96feda-4c26-4a1b-9fd5-57366aa86a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:22:42.318378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96feda-4c26-4a1b-9fd5-57366aa86a91 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:22:42.328415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1150/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:22:52.239729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=42 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:22:52.324199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=61 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:07.167499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a2f4-f23d-4756-a276-5feed471f273 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:07.168083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a2f4-f23d-4756-a276-5feed471f273 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:07.168083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a2f4-f23d-4756-a276-5feed471f273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:07.189683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-60d8a2f4-f23d-4756-a276-5feed471f273 None None] MFA Rules not processed for user `d2b2f1b8064945e4834be2050db26867`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:07.190961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-60d8a2f4-f23d-4756-a276-5feed471f273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:07.247378 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1165/2315] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:23:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:23:13.906037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96feda-4c26-4a1b-9fd5-57366aa86a91 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:13.907632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4b96feda-4c26-4a1b-9fd5-57366aa86a91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:13.921185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96feda-4c26-4a1b-9fd5-57366aa86a91 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:13.926105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:13.927027 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:13.927314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:13.927593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] PATH_INFO: `/v3/users/dd68e291b36347d29b568e3a24f53242` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:13.928839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd68e291b36347d29b568e3a24f53242)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:13.930775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:13.981499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd68e291b36347d29b568e3a24f53242'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:23:13.982171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd68e291b36347d29b568e3a24f53242'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:23:13.989991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd68e291b36347d29b568e3a24f53242'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:23:13.997485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd68e291b36347d29b568e3a24f53242'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:23:13.998203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea691c2d-3a57-46e3-b18c-304bcdd01181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd68e291b36347d29b568e3a24f53242'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:23:14.017326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1151/2316] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:23:13 2022] DELETE /identity/v3/users/dd68e291b36347d29b568e3a24f53242 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:23:14.195738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8a2f4-f23d-4756-a276-5feed471f273 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:14.211627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8a2f4-f23d-4756-a276-5feed471f273 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:14.282363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:14.283240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:14.283523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:14.283799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] PATH_INFO: `/v3/projects/0989411f98394c03824ad7f8185e29ad` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:14.285113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0989411f98394c03824ad7f8185e29ad)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:14.287034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:14.336240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0989411f98394c03824ad7f8185e29ad', 'request_id': 'req-a8025fcf-4252-4909-91a6-6029707ddf50'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:23:14.341998 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0989411f98394c03824ad7f8185e29ad', 'request_id': 'req-a8025fcf-4252-4909-91a6-6029707ddf50'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:23:14.353359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0989411f98394c03824ad7f8185e29ad', 'request_id': 'req-a8025fcf-4252-4909-91a6-6029707ddf50'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:23:14.366000 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] The token cache is being invalidate because project 0989411f98394c03824ad7f8185e29ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:23:14.366177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:23:14.366846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:23:14.368447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1166/2317] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:23:14 2022] DELETE /identity/v3/projects/0989411f98394c03824ad7f8185e29ad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:23:19.613706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a0fe-b4c0-48c8-8488-c9d0f15f24c1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:19.614211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a0fe-b4c0-48c8-8488-c9d0f15f24c1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:19.614306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a0fe-b4c0-48c8-8488-c9d0f15f24c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:19.632305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5915a0fe-b4c0-48c8-8488-c9d0f15f24c1 None None] MFA Rules not processed for user `090b5fdbe72e403db95a2e8dacbef7e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:19.633533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5915a0fe-b4c0-48c8-8488-c9d0f15f24c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:19.689509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1152/2318] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:23:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:23:24.362646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:28.459796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:28.462211 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:28.525436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8025fcf-4252-4909-91a6-6029707ddf50 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:28.529836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe87317-9b7d-40d2-bd82-fa709e08c16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:28.530485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe87317-9b7d-40d2-bd82-fa709e08c16a service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:28.530763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe87317-9b7d-40d2-bd82-fa709e08c16a service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:28.531038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe87317-9b7d-40d2-bd82-fa709e08c16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:28.532976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cbe87317-9b7d-40d2-bd82-fa709e08c16a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:28.608914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe87317-9b7d-40d2-bd82-fa709e08c16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:28.610553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe87317-9b7d-40d2-bd82-fa709e08c16a service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:28.622053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1167/2319] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:23:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:23:29.682416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:31.010463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915a0fe-b4c0-48c8-8488-c9d0f15f24c1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:31.022036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915a0fe-b4c0-48c8-8488-c9d0f15f24c1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:31.026636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396c36b-e61e-4171-96bd-00159fcc9765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:31.027290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396c36b-e61e-4171-96bd-00159fcc9765 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:31.027575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396c36b-e61e-4171-96bd-00159fcc9765 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:31.027854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396c36b-e61e-4171-96bd-00159fcc9765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:31.030071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0396c36b-e61e-4171-96bd-00159fcc9765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:31.044202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396c36b-e61e-4171-96bd-00159fcc9765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:31.045657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396c36b-e61e-4171-96bd-00159fcc9765 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:31.058079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1153/2320] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:23:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:23:35.290257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe87317-9b7d-40d2-bd82-fa709e08c16a service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:35.291830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cbe87317-9b7d-40d2-bd82-fa709e08c16a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:35.306417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe87317-9b7d-40d2-bd82-fa709e08c16a service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:35.314282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eab18-a03f-4e89-8e2a-7d403ebb5fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:35.315136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eab18-a03f-4e89-8e2a-7d403ebb5fa4 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:35.315422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eab18-a03f-4e89-8e2a-7d403ebb5fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:35.315689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eab18-a03f-4e89-8e2a-7d403ebb5fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:35.317780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f60eab18-a03f-4e89-8e2a-7d403ebb5fa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:35.384289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60eab18-a03f-4e89-8e2a-7d403ebb5fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:35.386107 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60eab18-a03f-4e89-8e2a-7d403ebb5fa4 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:35.396284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1168/2321] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:23:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:23:41.052318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=6 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:43.022097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241c9b2-f530-4d3b-8ad7-f0fbeac856cb None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:43.022726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241c9b2-f530-4d3b-8ad7-f0fbeac856cb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:43.022726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241c9b2-f530-4d3b-8ad7-f0fbeac856cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:43.041961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e241c9b2-f530-4d3b-8ad7-f0fbeac856cb None None] MFA Rules not processed for user `0bea4c8d195145a29eefee98e4b9ef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:43.043168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e241c9b2-f530-4d3b-8ad7-f0fbeac856cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:43.112317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1154/2322] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:23:44.765090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec72b-a3fc-4e9f-8d24-0c73fbfdca66 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:44.765567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec72b-a3fc-4e9f-8d24-0c73fbfdca66 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:44.765996 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec72b-a3fc-4e9f-8d24-0c73fbfdca66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:44.784098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-371ec72b-a3fc-4e9f-8d24-0c73fbfdca66 None None] MFA Rules not processed for user `f354a75ed51144769da1db0ec92e7980`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:44.785442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-371ec72b-a3fc-4e9f-8d24-0c73fbfdca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:44.793455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1169/2323] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:23:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:23:51.222276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241c9b2-f530-4d3b-8ad7-f0fbeac856cb None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:51.224150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e241c9b2-f530-4d3b-8ad7-f0fbeac856cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:51.398234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241c9b2-f530-4d3b-8ad7-f0fbeac856cb None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:51.406728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43ac6-4c9d-4cb4-9521-32de66afc51a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:51.408725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43ac6-4c9d-4cb4-9521-32de66afc51a service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:51.411769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43ac6-4c9d-4cb4-9521-32de66afc51a service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:51.413272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43ac6-4c9d-4cb4-9521-32de66afc51a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:51.417588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-30a43ac6-4c9d-4cb4-9521-32de66afc51a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:51.573509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43ac6-4c9d-4cb4-9521-32de66afc51a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:51.575770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43ac6-4c9d-4cb4-9521-32de66afc51a service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:51.592299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1155/2324] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:23:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:23:51.610591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec72b-a3fc-4e9f-8d24-0c73fbfdca66 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:51.634792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec72b-a3fc-4e9f-8d24-0c73fbfdca66 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:51.648952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc0de8-5016-475d-85ce-f94c64616d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:51.650106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc0de8-5016-475d-85ce-f94c64616d73 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:51.650455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc0de8-5016-475d-85ce-f94c64616d73 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:51.650791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc0de8-5016-475d-85ce-f94c64616d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:51.660705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc0de8-5016-475d-85ce-f94c64616d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:51.663042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc0de8-5016-475d-85ce-f94c64616d73 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:51.687832 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1170/2325] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:23:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:23:53.996105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43ac6-4c9d-4cb4-9521-32de66afc51a service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:53.997610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-30a43ac6-4c9d-4cb4-9521-32de66afc51a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:54.014860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43ac6-4c9d-4cb4-9521-32de66afc51a service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:54.021314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e151017-96e6-4bf6-a483-afe2f105f771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:54.021971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e151017-96e6-4bf6-a483-afe2f105f771 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:54.022256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e151017-96e6-4bf6-a483-afe2f105f771 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:54.022533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e151017-96e6-4bf6-a483-afe2f105f771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:54.024676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5e151017-96e6-4bf6-a483-afe2f105f771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:54.036888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e151017-96e6-4bf6-a483-afe2f105f771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:54.038553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e151017-96e6-4bf6-a483-afe2f105f771 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:54.048077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1156/2326] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:23:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:23:59.780170 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc0de8-5016-475d-85ce-f94c64616d73 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:59.787092 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:59.793483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc0de8-5016-475d-85ce-f94c64616d73 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:59.797869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818392f-3e00-4cbe-854e-eda13950271e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:59.798496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818392f-3e00-4cbe-854e-eda13950271e service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:59.798782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818392f-3e00-4cbe-854e-eda13950271e service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:59.799058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818392f-3e00-4cbe-854e-eda13950271e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:59.801018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7818392f-3e00-4cbe-854e-eda13950271e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:59.810981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818392f-3e00-4cbe-854e-eda13950271e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:59.812428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818392f-3e00-4cbe-854e-eda13950271e service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:59.820824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1171/2327] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:23:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:02.985374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d7b51-1a18-4bb5-9b36-776c93388cdf None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:02.985885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d7b51-1a18-4bb5-9b36-776c93388cdf None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:02.985885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d7b51-1a18-4bb5-9b36-776c93388cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.007634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-125d7b51-1a18-4bb5-9b36-776c93388cdf None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:03.008897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-125d7b51-1a18-4bb5-9b36-776c93388cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:03.062272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:03.080397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1157/2328] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jul 14 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:03.139763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818392f-3e00-4cbe-854e-eda13950271e service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:03.142257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7818392f-3e00-4cbe-854e-eda13950271e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:03.226873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818392f-3e00-4cbe-854e-eda13950271e service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:03.232422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3a45d-19aa-4756-8b43-1a4cd0cadd00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:03.233342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3a45d-19aa-4756-8b43-1a4cd0cadd00 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.233637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3a45d-19aa-4756-8b43-1a4cd0cadd00 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.233917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3a45d-19aa-4756-8b43-1a4cd0cadd00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.244609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3a45d-19aa-4756-8b43-1a4cd0cadd00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:03.246419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3a45d-19aa-4756-8b43-1a4cd0cadd00 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:03.255859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1172/2329] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:24:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:24:10.320973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d7b51-1a18-4bb5-9b36-776c93388cdf None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:10.358230 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d7b51-1a18-4bb5-9b36-776c93388cdf None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:10.370895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884cf78-7f32-4f27-930e-91887c6861b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:10.371772 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884cf78-7f32-4f27-930e-91887c6861b1 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:10.373288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884cf78-7f32-4f27-930e-91887c6861b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:10.373813 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884cf78-7f32-4f27-930e-91887c6861b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:10.379734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f884cf78-7f32-4f27-930e-91887c6861b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:10.412589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884cf78-7f32-4f27-930e-91887c6861b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:10.414854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884cf78-7f32-4f27-930e-91887c6861b1 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:10.427191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1158/2330] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:10.771219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3a45d-19aa-4756-8b43-1a4cd0cadd00 service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:10.772923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d2a3a45d-19aa-4756-8b43-1a4cd0cadd00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:10.846594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3a45d-19aa-4756-8b43-1a4cd0cadd00 service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:10.852382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:10.853556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:10.854086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:10.854438 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] PATH_INFO: `/v3/users/59941fa402854b44a5b7feebdbd2c5cf` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:10.856030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59941fa402854b44a5b7feebdbd2c5cf)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:10.858293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:10.915810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59941fa402854b44a5b7feebdbd2c5cf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:10.925438 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59941fa402854b44a5b7feebdbd2c5cf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:10.926259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59941fa402854b44a5b7feebdbd2c5cf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:10.934685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59941fa402854b44a5b7feebdbd2c5cf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:10.935418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59941fa402854b44a5b7feebdbd2c5cf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:10.953256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:10.960484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1173/2331] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:10 2022] DELETE /identity/v3/users/59941fa402854b44a5b7feebdbd2c5cf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:11.139870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884cf78-7f32-4f27-930e-91887c6861b1 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:11.151826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884cf78-7f32-4f27-930e-91887c6861b1 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:11.224265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:11.225182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.225464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.225739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] PATH_INFO: `/v3/projects/bae79cca54fb4fa28705c48d30410bd0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.227057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae79cca54fb4fa28705c48d30410bd0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:11.229097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:11.279316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae79cca54fb4fa28705c48d30410bd0', 'request_id': 'req-bd893558-24b7-4775-ab58-b51b70ba291b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.287728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae79cca54fb4fa28705c48d30410bd0', 'request_id': 'req-bd893558-24b7-4775-ab58-b51b70ba291b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.294012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae79cca54fb4fa28705c48d30410bd0', 'request_id': 'req-bd893558-24b7-4775-ab58-b51b70ba291b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.304006 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] The token cache is being invalidate because project bae79cca54fb4fa28705c48d30410bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:11.304292 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.304935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.306477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1159/2332] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:11 2022] DELETE /identity/v3/projects/bae79cca54fb4fa28705c48d30410bd0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:11.310574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:11.312142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:11.326051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb8a6-3966-4ddb-a68d-75a53ff43ec9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:11.387048 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:11.387899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.388167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.388445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] PATH_INFO: `/v3/users/1bbe4ed690db4e05bb52fdf78dc9a41a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.389704 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bbe4ed690db4e05bb52fdf78dc9a41a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:11.392040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:11.445601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbe4ed690db4e05bb52fdf78dc9a41a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.453858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbe4ed690db4e05bb52fdf78dc9a41a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.454524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbe4ed690db4e05bb52fdf78dc9a41a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.461741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbe4ed690db4e05bb52fdf78dc9a41a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.462411 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbe4ed690db4e05bb52fdf78dc9a41a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.480180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1174/2333] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:11 2022] DELETE /identity/v3/users/1bbe4ed690db4e05bb52fdf78dc9a41a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:11.661613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:11.663150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:11.676987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd893558-24b7-4775-ab58-b51b70ba291b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:11.740753 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:11.741300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.741680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.742058 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] PATH_INFO: `/v3/projects/3fa80e9464a64bd0a976128a688416b8` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.743443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa80e9464a64bd0a976128a688416b8)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:11.745428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:11.757865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:11.798145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa80e9464a64bd0a976128a688416b8', 'request_id': 'req-6bb2ff29-5934-4ede-8a6d-c2105397b822'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.806371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa80e9464a64bd0a976128a688416b8', 'request_id': 'req-6bb2ff29-5934-4ede-8a6d-c2105397b822'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.812712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa80e9464a64bd0a976128a688416b8', 'request_id': 'req-6bb2ff29-5934-4ede-8a6d-c2105397b822'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.822888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] The token cache is being invalidate because project 3fa80e9464a64bd0a976128a688416b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:11.823171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.823798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:11.825376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1160/2334] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:11 2022] DELETE /identity/v3/projects/3fa80e9464a64bd0a976128a688416b8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:16.828407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:16.830021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:16.892185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404175a2-74f9-45a4-817c-dd032039fdd9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:16.923443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:16.944586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65c3f-beff-4732-a585-e979249751c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:16.945331 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65c3f-beff-4732-a585-e979249751c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:16.945617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65c3f-beff-4732-a585-e979249751c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:16.945895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65c3f-beff-4732-a585-e979249751c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:16.947906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4ca65c3f-beff-4732-a585-e979249751c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:17.013856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca65c3f-beff-4732-a585-e979249751c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:17.015600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca65c3f-beff-4732-a585-e979249751c1 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:17.025968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1175/2335] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:17.209460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:17.211048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:17.289520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2ff29-5934-4ede-8a6d-c2105397b822 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:17.295688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36e94f-3dd0-4b46-b73e-c817fb00e409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:17.296350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e94f-3dd0-4b46-b73e-c817fb00e409 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:17.296636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e94f-3dd0-4b46-b73e-c817fb00e409 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:17.296942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e94f-3dd0-4b46-b73e-c817fb00e409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:17.298850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-da36e94f-3dd0-4b46-b73e-c817fb00e409 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:17.359545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36e94f-3dd0-4b46-b73e-c817fb00e409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:17.361231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36e94f-3dd0-4b46-b73e-c817fb00e409 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:17.372052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1161/2336] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:20.034254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65c3f-beff-4732-a585-e979249751c1 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.036417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4ca65c3f-beff-4732-a585-e979249751c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:20.050540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65c3f-beff-4732-a585-e979249751c1 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.055522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.056574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.056921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.057201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] PATH_INFO: `/v3/users/d2b2f1b8064945e4834be2050db26867` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.058414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b2f1b8064945e4834be2050db26867)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.060358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.120002 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b2f1b8064945e4834be2050db26867'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:20.131080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b2f1b8064945e4834be2050db26867'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:20.131757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b2f1b8064945e4834be2050db26867'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:20.140186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b2f1b8064945e4834be2050db26867'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:20.140885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aab83f2c-5313-4305-9c40-aa7f767c4a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b2f1b8064945e4834be2050db26867'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:20.159578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1176/2337] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:20 2022] DELETE /identity/v3/users/d2b2f1b8064945e4834be2050db26867 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:20.344343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36e94f-3dd0-4b46-b73e-c817fb00e409 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.359039 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36e94f-3dd0-4b46-b73e-c817fb00e409 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.402097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:20.429992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.430886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.431174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.431461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] PATH_INFO: `/v3/projects/2edb319adbd74bb7931173d4f46a67df` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.432866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2edb319adbd74bb7931173d4f46a67df)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.434801 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.483970 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2edb319adbd74bb7931173d4f46a67df', 'request_id': 'req-033a3633-ed22-4848-a86a-8639657c50e3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:20.492461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2edb319adbd74bb7931173d4f46a67df', 'request_id': 'req-033a3633-ed22-4848-a86a-8639657c50e3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:20.498916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2edb319adbd74bb7931173d4f46a67df', 'request_id': 'req-033a3633-ed22-4848-a86a-8639657c50e3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:20.509937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] The token cache is being invalidate because project 2edb319adbd74bb7931173d4f46a67df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:20.510434 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:20.511134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-033a3633-ed22-4848-a86a-8639657c50e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:20.512928 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1162/2338] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:20 2022] DELETE /identity/v3/projects/2edb319adbd74bb7931173d4f46a67df => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:20.518254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438d4d0-fc5f-44e5-811d-d025c54890e8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.518635 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438d4d0-fc5f-44e5-811d-d025c54890e8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.518919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438d4d0-fc5f-44e5-811d-d025c54890e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.537442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f438d4d0-fc5f-44e5-811d-d025c54890e8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:20.538647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f438d4d0-fc5f-44e5-811d-d025c54890e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:20.593011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:20.606854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1177/2339] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:20.615534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edc5ef-7e8c-4da2-b398-193ceabb0c9d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.615828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edc5ef-7e8c-4da2-b398-193ceabb0c9d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.616101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edc5ef-7e8c-4da2-b398-193ceabb0c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.635372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f3edc5ef-7e8c-4da2-b398-193ceabb0c9d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:20.636574 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f3edc5ef-7e8c-4da2-b398-193ceabb0c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:20.645620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1163/2340] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:20.649938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438d4d0-fc5f-44e5-811d-d025c54890e8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.660135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438d4d0-fc5f-44e5-811d-d025c54890e8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.665312 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d91c6-f038-4a52-9c33-dd26f6b3fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.665981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d91c6-f038-4a52-9c33-dd26f6b3fd04 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.666266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d91c6-f038-4a52-9c33-dd26f6b3fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.666542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d91c6-f038-4a52-9c33-dd26f6b3fd04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.667271 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d91c6-f038-4a52-9c33-dd26f6b3fd04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:20.667608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d91c6-f038-4a52-9c33-dd26f6b3fd04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.669291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d91c6-f038-4a52-9c33-dd26f6b3fd04 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.681383 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1178/2341] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:20.685729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edc5ef-7e8c-4da2-b398-193ceabb0c9d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.695657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edc5ef-7e8c-4da2-b398-193ceabb0c9d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.700630 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75879e01-b6e1-492e-b855-c4b1645265be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.701337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75879e01-b6e1-492e-b855-c4b1645265be admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.701599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75879e01-b6e1-492e-b855-c4b1645265be admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.701875 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75879e01-b6e1-492e-b855-c4b1645265be admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.702554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75879e01-b6e1-492e-b855-c4b1645265be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.704467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75879e01-b6e1-492e-b855-c4b1645265be admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.735144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1164/2342] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:20 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:20.741468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d91c6-f038-4a52-9c33-dd26f6b3fd04 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.755657 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d91c6-f038-4a52-9c33-dd26f6b3fd04 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.815902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34190598-cbc0-4650-894b-4780186c6c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.816585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34190598-cbc0-4650-894b-4780186c6c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.816898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34190598-cbc0-4650-894b-4780186c6c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.817177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34190598-cbc0-4650-894b-4780186c6c75 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.817983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34190598-cbc0-4650-894b-4780186c6c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.819962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34190598-cbc0-4650-894b-4780186c6c75 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.841672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1179/2343] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:20 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:20.846071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75879e01-b6e1-492e-b855-c4b1645265be admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.857355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75879e01-b6e1-492e-b855-c4b1645265be admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.862114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df575e7-a0c3-480b-bff9-b9b4e71a9c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.863060 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df575e7-a0c3-480b-bff9-b9b4e71a9c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.863356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df575e7-a0c3-480b-bff9-b9b4e71a9c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.863647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df575e7-a0c3-480b-bff9-b9b4e71a9c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.864391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df575e7-a0c3-480b-bff9-b9b4e71a9c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.866089 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df575e7-a0c3-480b-bff9-b9b4e71a9c29 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.877236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1165/2344] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:20.881546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34190598-cbc0-4650-894b-4780186c6c75 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.892337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34190598-cbc0-4650-894b-4780186c6c75 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.897128 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea373ed4-d791-4430-bbfa-4ee35e58d860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.897798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373ed4-d791-4430-bbfa-4ee35e58d860 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.898076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373ed4-d791-4430-bbfa-4ee35e58d860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.898369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373ed4-d791-4430-bbfa-4ee35e58d860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.899122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea373ed4-d791-4430-bbfa-4ee35e58d860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.900808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea373ed4-d791-4430-bbfa-4ee35e58d860 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.911514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1180/2345] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:20.915785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df575e7-a0c3-480b-bff9-b9b4e71a9c29 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.926560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df575e7-a0c3-480b-bff9-b9b4e71a9c29 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.931893 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a008efd-ecf3-4f3c-8b7f-b19ec6b043b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.932852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008efd-ecf3-4f3c-8b7f-b19ec6b043b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.933134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008efd-ecf3-4f3c-8b7f-b19ec6b043b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.933408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008efd-ecf3-4f3c-8b7f-b19ec6b043b9 admin admin] PATH_INFO: `/v3/projects/bcf8187e44e146f9bb89be60b48c1369/users/ef1ec7f456a148359f8c57e27bb0044e/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.949380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a008efd-ecf3-4f3c-8b7f-b19ec6b043b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf8187e44e146f9bb89be60b48c1369, user_id=ef1ec7f456a148359f8c57e27bb0044e, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.952033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a008efd-ecf3-4f3c-8b7f-b19ec6b043b9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.966743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1166/2346] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:20 2022] PUT /identity/v3/projects/bcf8187e44e146f9bb89be60b48c1369/users/ef1ec7f456a148359f8c57e27bb0044e/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:20.976940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0edee-fa23-4999-88e9-2b9260b3dc57 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.977233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0edee-fa23-4999-88e9-2b9260b3dc57 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.977514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0edee-fa23-4999-88e9-2b9260b3dc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.006948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3ca0edee-fa23-4999-88e9-2b9260b3dc57 None None] MFA Rules not processed for user `ef1ec7f456a148359f8c57e27bb0044e`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:21.008101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3ca0edee-fa23-4999-88e9-2b9260b3dc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:21.080840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1181/2347] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:21.085567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a008efd-ecf3-4f3c-8b7f-b19ec6b043b9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:21.150878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a008efd-ecf3-4f3c-8b7f-b19ec6b043b9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:21.156790 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5cd6-97d3-42c7-905e-3a4f42524d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:21.157447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5cd6-97d3-42c7-905e-3a4f42524d50 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.157726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5cd6-97d3-42c7-905e-3a4f42524d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.157995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5cd6-97d3-42c7-905e-3a4f42524d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.158680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5cd6-97d3-42c7-905e-3a4f42524d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:21.160654 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5cd6-97d3-42c7-905e-3a4f42524d50 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:21.165111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:21.190330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1167/2348] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:21 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:21.194616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0edee-fa23-4999-88e9-2b9260b3dc57 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:21.206421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0edee-fa23-4999-88e9-2b9260b3dc57 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:21.262138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:21.275806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb0d95-16eb-43f9-9a05-b46e44ec10f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:21.276485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb0d95-16eb-43f9-9a05-b46e44ec10f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.276793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb0d95-16eb-43f9-9a05-b46e44ec10f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.277067 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb0d95-16eb-43f9-9a05-b46e44ec10f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.277767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb0d95-16eb-43f9-9a05-b46e44ec10f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:21.279691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb0d95-16eb-43f9-9a05-b46e44ec10f4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:21.302659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1182/2349] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:21 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:21.306776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5cd6-97d3-42c7-905e-3a4f42524d50 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:21.317519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5cd6-97d3-42c7-905e-3a4f42524d50 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:21.322513 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13138e1-7e5b-47dc-a136-ad99cb8e6eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:21.323189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13138e1-7e5b-47dc-a136-ad99cb8e6eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.323476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13138e1-7e5b-47dc-a136-ad99cb8e6eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.323754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13138e1-7e5b-47dc-a136-ad99cb8e6eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.324491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13138e1-7e5b-47dc-a136-ad99cb8e6eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:21.326150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13138e1-7e5b-47dc-a136-ad99cb8e6eb6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:21.337026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1168/2350] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:21.341241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb0d95-16eb-43f9-9a05-b46e44ec10f4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:21.351978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb0d95-16eb-43f9-9a05-b46e44ec10f4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:21.357700 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8fdb9-15f8-4a71-8b9b-09ac03b638f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:21.358585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fdb9-15f8-4a71-8b9b-09ac03b638f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.358861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fdb9-15f8-4a71-8b9b-09ac03b638f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.359126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fdb9-15f8-4a71-8b9b-09ac03b638f5 admin admin] PATH_INFO: `/v3/projects/a339f577e77343fe89a9bd8c750c1536/users/b4b32486cbd64b8b8c1bf3626d40a416/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.374819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8fdb9-15f8-4a71-8b9b-09ac03b638f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a339f577e77343fe89a9bd8c750c1536, user_id=b4b32486cbd64b8b8c1bf3626d40a416, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:21.377562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8fdb9-15f8-4a71-8b9b-09ac03b638f5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:21.393264 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1183/2351] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:21 2022] PUT /identity/v3/projects/a339f577e77343fe89a9bd8c750c1536/users/b4b32486cbd64b8b8c1bf3626d40a416/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:21.397553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13138e1-7e5b-47dc-a136-ad99cb8e6eb6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:21.407896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13138e1-7e5b-47dc-a136-ad99cb8e6eb6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:21.466386 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda7437-eede-4c5e-ae46-39e88ff10376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:21.467070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda7437-eede-4c5e-ae46-39e88ff10376 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.467356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda7437-eede-4c5e-ae46-39e88ff10376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.467633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda7437-eede-4c5e-ae46-39e88ff10376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.468396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda7437-eede-4c5e-ae46-39e88ff10376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:21.470081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda7437-eede-4c5e-ae46-39e88ff10376 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:21.480598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1169/2352] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:21.484888 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8fdb9-15f8-4a71-8b9b-09ac03b638f5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:21.495713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8fdb9-15f8-4a71-8b9b-09ac03b638f5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:21.503583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f88d-0099-4e37-a236-ec0ef4a96932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:21.504417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f88d-0099-4e37-a236-ec0ef4a96932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.504710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f88d-0099-4e37-a236-ec0ef4a96932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.505008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f88d-0099-4e37-a236-ec0ef4a96932 admin admin] PATH_INFO: `/v3/projects/a339f577e77343fe89a9bd8c750c1536/users/b4b32486cbd64b8b8c1bf3626d40a416/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.507229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7f88d-0099-4e37-a236-ec0ef4a96932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a339f577e77343fe89a9bd8c750c1536, user_id=b4b32486cbd64b8b8c1bf3626d40a416, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:21.509935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7f88d-0099-4e37-a236-ec0ef4a96932 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:21.521498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1184/2353] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:21 2022] PUT /identity/v3/projects/a339f577e77343fe89a9bd8c750c1536/users/b4b32486cbd64b8b8c1bf3626d40a416/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:21.531655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab7f6-3d2b-449c-9a37-071311dbc33f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.531945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab7f6-3d2b-449c-9a37-071311dbc33f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.532218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab7f6-3d2b-449c-9a37-071311dbc33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.561968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-607ab7f6-3d2b-449c-9a37-071311dbc33f None None] MFA Rules not processed for user `b4b32486cbd64b8b8c1bf3626d40a416`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:21.563217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-607ab7f6-3d2b-449c-9a37-071311dbc33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:21.633042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1170/2354] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:21.646008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f88d-0099-4e37-a236-ec0ef4a96932 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:21.648780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ced7f88d-0099-4e37-a236-ec0ef4a96932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:21.716145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f88d-0099-4e37-a236-ec0ef4a96932 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:21.720852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44790f56-d205-4069-b039-f1ebd83c2835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:21.721511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790f56-d205-4069-b039-f1ebd83c2835 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.721794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790f56-d205-4069-b039-f1ebd83c2835 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.722064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790f56-d205-4069-b039-f1ebd83c2835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.731950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44790f56-d205-4069-b039-f1ebd83c2835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:21.733430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44790f56-d205-4069-b039-f1ebd83c2835 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:21.744315 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1185/2355] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:22.187499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab7f6-3d2b-449c-9a37-071311dbc33f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.249949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:22.255849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab7f6-3d2b-449c-9a37-071311dbc33f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:22.262215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:22.263091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.263382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.263777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] PATH_INFO: `/v3/users/ef1ec7f456a148359f8c57e27bb0044e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.265736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1ec7f456a148359f8c57e27bb0044e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:22.268655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:22.320847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1ec7f456a148359f8c57e27bb0044e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:22.321409 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1ec7f456a148359f8c57e27bb0044e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:22.329568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1ec7f456a148359f8c57e27bb0044e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:22.336827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1ec7f456a148359f8c57e27bb0044e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:22.337498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1ec7f456a148359f8c57e27bb0044e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:22.354519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1171/2356] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:22 2022] DELETE /identity/v3/users/ef1ec7f456a148359f8c57e27bb0044e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:22.359183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe9d0-0fc9-44cd-91ef-075c49ba8fd3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.359650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe9d0-0fc9-44cd-91ef-075c49ba8fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.359747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe9d0-0fc9-44cd-91ef-075c49ba8fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.378017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-512fe9d0-0fc9-44cd-91ef-075c49ba8fd3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:22.379359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-512fe9d0-0fc9-44cd-91ef-075c49ba8fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:22.442580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1186/2357] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:24:22.452920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.454453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:22.513638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e799e0-12ac-4292-95ad-56033aec2d75 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:22.518647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c2ddd-a1f7-47e1-8adb-15aa749de54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:22.519300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2ddd-a1f7-47e1-8adb-15aa749de54d service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.519583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2ddd-a1f7-47e1-8adb-15aa749de54d service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.519856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2ddd-a1f7-47e1-8adb-15aa749de54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.529759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c2ddd-a1f7-47e1-8adb-15aa749de54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:22.531195 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c2ddd-a1f7-47e1-8adb-15aa749de54d service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:22.540900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1172/2358] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:22.836033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fe9d0-0fc9-44cd-91ef-075c49ba8fd3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.837530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-512fe9d0-0fc9-44cd-91ef-075c49ba8fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:22.850714 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fe9d0-0fc9-44cd-91ef-075c49ba8fd3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:22.855510 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:22.856413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.856747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.857069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] PATH_INFO: `/v3/projects/bcf8187e44e146f9bb89be60b48c1369` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.858272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf8187e44e146f9bb89be60b48c1369)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:22.860327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:22.905451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:22.911889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf8187e44e146f9bb89be60b48c1369', 'request_id': 'req-f8322862-7125-45e4-b606-e876a18b5088'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:22.918514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf8187e44e146f9bb89be60b48c1369', 'request_id': 'req-f8322862-7125-45e4-b606-e876a18b5088'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:22.926997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf8187e44e146f9bb89be60b48c1369', 'request_id': 'req-f8322862-7125-45e4-b606-e876a18b5088'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:22.938668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] The token cache is being invalidate because project bcf8187e44e146f9bb89be60b48c1369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:22.938893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:22.939609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:22.941382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1187/2359] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:22 2022] DELETE /identity/v3/projects/bcf8187e44e146f9bb89be60b48c1369 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:22.945710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c2ddd-a1f7-47e1-8adb-15aa749de54d service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.955636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c2ddd-a1f7-47e1-8adb-15aa749de54d service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:23.019724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:23.020969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.021314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.021603 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] PATH_INFO: `/v3/users/b4b32486cbd64b8b8c1bf3626d40a416` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.023331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b32486cbd64b8b8c1bf3626d40a416)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:23.026349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:23.052594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:23.081306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b32486cbd64b8b8c1bf3626d40a416'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:23.081965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b32486cbd64b8b8c1bf3626d40a416'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:23.092375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b32486cbd64b8b8c1bf3626d40a416'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:23.099140 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b32486cbd64b8b8c1bf3626d40a416'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:23.099982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7548ee7-c3e4-4895-9117-7ddc2e7207ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b32486cbd64b8b8c1bf3626d40a416'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:23.119149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1173/2360] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:22 2022] DELETE /identity/v3/users/b4b32486cbd64b8b8c1bf3626d40a416 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:23.476600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:23.478922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:23.499125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8322862-7125-45e4-b606-e876a18b5088 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:23.563023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:23.564358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.564702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.565133 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] PATH_INFO: `/v3/projects/a339f577e77343fe89a9bd8c750c1536` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.566915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a339f577e77343fe89a9bd8c750c1536)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:23.569109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:23.632420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a339f577e77343fe89a9bd8c750c1536', 'request_id': 'req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:23.638679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a339f577e77343fe89a9bd8c750c1536', 'request_id': 'req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:23.648571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a339f577e77343fe89a9bd8c750c1536', 'request_id': 'req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:23.659913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] The token cache is being invalidate because project a339f577e77343fe89a9bd8c750c1536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:23.660198 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:23.660913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-ec7bf894-71fc-41ca-ad2c-a9bb55dc3b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:23.662523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1188/2361] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:23 2022] DELETE /identity/v3/projects/a339f577e77343fe89a9bd8c750c1536 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:23.667634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca5c46-36b4-456b-9553-05f5881532f4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.668112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca5c46-36b4-456b-9553-05f5881532f4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.668209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca5c46-36b4-456b-9553-05f5881532f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.686992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-81ca5c46-36b4-456b-9553-05f5881532f4 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:23.688246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-81ca5c46-36b4-456b-9553-05f5881532f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:23.752758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1174/2362] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:24:23.761918 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc40357-7d7d-467a-8cc9-bbd1f679afdd None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.762229 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc40357-7d7d-467a-8cc9-bbd1f679afdd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.762507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc40357-7d7d-467a-8cc9-bbd1f679afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.782039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0dc40357-7d7d-467a-8cc9-bbd1f679afdd None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:23.783240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0dc40357-7d7d-467a-8cc9-bbd1f679afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:23.792418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1189/2363] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:23.796735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca5c46-36b4-456b-9553-05f5881532f4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:23.807289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca5c46-36b4-456b-9553-05f5881532f4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:23.812415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a4df7-40c4-4c72-89cf-c254a074b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:23.813108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4df7-40c4-4c72-89cf-c254a074b09b admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.813392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4df7-40c4-4c72-89cf-c254a074b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.813662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4df7-40c4-4c72-89cf-c254a074b09b admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.814391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4df7-40c4-4c72-89cf-c254a074b09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:23.814696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4df7-40c4-4c72-89cf-c254a074b09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:23.816306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4df7-40c4-4c72-89cf-c254a074b09b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:23.828683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1175/2364] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:23.833040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc40357-7d7d-467a-8cc9-bbd1f679afdd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:23.844028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc40357-7d7d-467a-8cc9-bbd1f679afdd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:23.851735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c69ef9-c92c-4237-a0a9-4a9fa192ce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:23.852408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c69ef9-c92c-4237-a0a9-4a9fa192ce44 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.852704 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c69ef9-c92c-4237-a0a9-4a9fa192ce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.852994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c69ef9-c92c-4237-a0a9-4a9fa192ce44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.853690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c69ef9-c92c-4237-a0a9-4a9fa192ce44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:23.855601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c69ef9-c92c-4237-a0a9-4a9fa192ce44 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:23.885676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1190/2365] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:23 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:23.890455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a4df7-40c4-4c72-89cf-c254a074b09b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:23.900490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a4df7-40c4-4c72-89cf-c254a074b09b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:23.962569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042a9d-0547-4ba8-9248-3914d73c599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:23.963313 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042a9d-0547-4ba8-9248-3914d73c599c admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.963595 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042a9d-0547-4ba8-9248-3914d73c599c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.963868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042a9d-0547-4ba8-9248-3914d73c599c admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.964592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40042a9d-0547-4ba8-9248-3914d73c599c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:23.966609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40042a9d-0547-4ba8-9248-3914d73c599c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:23.988471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1176/2366] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:23 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:24:23.992678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c69ef9-c92c-4237-a0a9-4a9fa192ce44 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:24.003571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c69ef9-c92c-4237-a0a9-4a9fa192ce44 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:24.009214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedeb4c-9817-498c-b6a2-e2a068604c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:24.009894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedeb4c-9817-498c-b6a2-e2a068604c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.010160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedeb4c-9817-498c-b6a2-e2a068604c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.010431 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedeb4c-9817-498c-b6a2-e2a068604c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.011169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedeb4c-9817-498c-b6a2-e2a068604c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:24.012819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedeb4c-9817-498c-b6a2-e2a068604c4a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:24.023962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1191/2367] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:24.028099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042a9d-0547-4ba8-9248-3914d73c599c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:24.038670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042a9d-0547-4ba8-9248-3914d73c599c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:24.043623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934be183-35cf-4dab-8f5d-a1af3e0c9a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:24.044276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934be183-35cf-4dab-8f5d-a1af3e0c9a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.044591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934be183-35cf-4dab-8f5d-a1af3e0c9a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.044899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934be183-35cf-4dab-8f5d-a1af3e0c9a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.045627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934be183-35cf-4dab-8f5d-a1af3e0c9a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:24.047204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934be183-35cf-4dab-8f5d-a1af3e0c9a71 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:24.057605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1177/2368] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:24.061971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedeb4c-9817-498c-b6a2-e2a068604c4a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:24.072483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedeb4c-9817-498c-b6a2-e2a068604c4a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:24.078003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18f6be-adcd-4553-b360-ef3a09462ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:24.078893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f6be-adcd-4553-b360-ef3a09462ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.079173 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f6be-adcd-4553-b360-ef3a09462ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.079478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f6be-adcd-4553-b360-ef3a09462ddb admin admin] PATH_INFO: `/v3/projects/fedc51deb34d48e8b51968c9421b3d66/users/f8ddd33ce55441fab31045bf155ccd7b/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.095838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18f6be-adcd-4553-b360-ef3a09462ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedc51deb34d48e8b51968c9421b3d66, user_id=f8ddd33ce55441fab31045bf155ccd7b, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:24.098531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18f6be-adcd-4553-b360-ef3a09462ddb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:24.101643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:24.115261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1192/2369] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:24 2022] PUT /identity/v3/projects/fedc51deb34d48e8b51968c9421b3d66/users/f8ddd33ce55441fab31045bf155ccd7b/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:24.125725 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ff53-192b-4ac1-a560-eed676a9ce6f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.126012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ff53-192b-4ac1-a560-eed676a9ce6f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.126287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ff53-192b-4ac1-a560-eed676a9ce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.133703 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:24.155908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ec62ff53-192b-4ac1-a560-eed676a9ce6f None None] MFA Rules not processed for user `f8ddd33ce55441fab31045bf155ccd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:24.157175 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ec62ff53-192b-4ac1-a560-eed676a9ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:24.225964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1178/2370] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:24.230770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18f6be-adcd-4553-b360-ef3a09462ddb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:24.298017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18f6be-adcd-4553-b360-ef3a09462ddb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:24.303465 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f7111-a3d6-49e6-9670-00b450cbcf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:24.304124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f7111-a3d6-49e6-9670-00b450cbcf07 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.304402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f7111-a3d6-49e6-9670-00b450cbcf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.304680 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f7111-a3d6-49e6-9670-00b450cbcf07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.305379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f7111-a3d6-49e6-9670-00b450cbcf07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:24.307278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f7111-a3d6-49e6-9670-00b450cbcf07 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:24.335760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1193/2371] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:24 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:24.339911 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62ff53-192b-4ac1-a560-eed676a9ce6f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:24.352803 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62ff53-192b-4ac1-a560-eed676a9ce6f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:24.413622 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0f857-5cff-4c53-b33d-bff1230b11a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:24.414296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0f857-5cff-4c53-b33d-bff1230b11a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.414598 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0f857-5cff-4c53-b33d-bff1230b11a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.414853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0f857-5cff-4c53-b33d-bff1230b11a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.415550 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0f857-5cff-4c53-b33d-bff1230b11a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:24.417466 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0f857-5cff-4c53-b33d-bff1230b11a4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:24.441542 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1179/2372] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:24 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:24.445537 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f7111-a3d6-49e6-9670-00b450cbcf07 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:24.455601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f7111-a3d6-49e6-9670-00b450cbcf07 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:24.460370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba961b79-1fb3-42eb-8d6d-3c5c39dd1f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:24.461076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961b79-1fb3-42eb-8d6d-3c5c39dd1f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.461354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961b79-1fb3-42eb-8d6d-3c5c39dd1f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.461624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961b79-1fb3-42eb-8d6d-3c5c39dd1f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.462348 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba961b79-1fb3-42eb-8d6d-3c5c39dd1f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:24.463927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba961b79-1fb3-42eb-8d6d-3c5c39dd1f72 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:24.475297 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1194/2373] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:24.479482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0f857-5cff-4c53-b33d-bff1230b11a4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:24.490242 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0f857-5cff-4c53-b33d-bff1230b11a4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:24.495073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142355a-a943-4eb8-96ca-ab5ca61d84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:24.495971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142355a-a943-4eb8-96ca-ab5ca61d84c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.496256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142355a-a943-4eb8-96ca-ab5ca61d84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.496534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142355a-a943-4eb8-96ca-ab5ca61d84c7 admin admin] PATH_INFO: `/v3/projects/9f7fb41de9cb431781a496e586b90d4d/users/e26ead587e34465a8c76fd866110844f/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.512025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142355a-a943-4eb8-96ca-ab5ca61d84c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7fb41de9cb431781a496e586b90d4d, user_id=e26ead587e34465a8c76fd866110844f, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:24.515014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142355a-a943-4eb8-96ca-ab5ca61d84c7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:24.529430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1180/2374] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:24 2022] PUT /identity/v3/projects/9f7fb41de9cb431781a496e586b90d4d/users/e26ead587e34465a8c76fd866110844f/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:24:24.533501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba961b79-1fb3-42eb-8d6d-3c5c39dd1f72 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:24.544033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba961b79-1fb3-42eb-8d6d-3c5c39dd1f72 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:24.602735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8a33d-e121-4803-9261-d997c8df1399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:24.603404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8a33d-e121-4803-9261-d997c8df1399 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.603683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8a33d-e121-4803-9261-d997c8df1399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.603940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8a33d-e121-4803-9261-d997c8df1399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.604669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8a33d-e121-4803-9261-d997c8df1399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:24.606284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8a33d-e121-4803-9261-d997c8df1399 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:24.616327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1195/2375] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:24:24.620615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142355a-a943-4eb8-96ca-ab5ca61d84c7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:24.631191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142355a-a943-4eb8-96ca-ab5ca61d84c7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:24.636243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946823-0d49-4f34-8c08-0bac7d37c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:24.637151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946823-0d49-4f34-8c08-0bac7d37c806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.637428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946823-0d49-4f34-8c08-0bac7d37c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.637702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946823-0d49-4f34-8c08-0bac7d37c806 admin admin] PATH_INFO: `/v3/projects/9f7fb41de9cb431781a496e586b90d4d/users/e26ead587e34465a8c76fd866110844f/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.639996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946823-0d49-4f34-8c08-0bac7d37c806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7fb41de9cb431781a496e586b90d4d, user_id=e26ead587e34465a8c76fd866110844f, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:24.642694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946823-0d49-4f34-8c08-0bac7d37c806 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:24.653498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1181/2376] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:24 2022] PUT /identity/v3/projects/9f7fb41de9cb431781a496e586b90d4d/users/e26ead587e34465a8c76fd866110844f/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:24:24.663863 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06793929-bfb5-4882-92c8-4d29242bdb29 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.664158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06793929-bfb5-4882-92c8-4d29242bdb29 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.664438 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06793929-bfb5-4882-92c8-4d29242bdb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.690705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-06793929-bfb5-4882-92c8-4d29242bdb29 None None] MFA Rules not processed for user `e26ead587e34465a8c76fd866110844f`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:24.691901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-06793929-bfb5-4882-92c8-4d29242bdb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:24.744525 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:24.763224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1196/2377] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:24.774378 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946823-0d49-4f34-8c08-0bac7d37c806 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:24.776106 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1b946823-0d49-4f34-8c08-0bac7d37c806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:24.831749 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:24.837748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946823-0d49-4f34-8c08-0bac7d37c806 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:24.841818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033efa0f-cd18-4ddb-9194-888319cf3255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:24.842461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efa0f-cd18-4ddb-9194-888319cf3255 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:24.842738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efa0f-cd18-4ddb-9194-888319cf3255 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:24.843014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efa0f-cd18-4ddb-9194-888319cf3255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:24.851897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033efa0f-cd18-4ddb-9194-888319cf3255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:24.853359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033efa0f-cd18-4ddb-9194-888319cf3255 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:24.862777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1182/2378] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:26.260350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06793929-bfb5-4882-92c8-4d29242bdb29 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.334935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06793929-bfb5-4882-92c8-4d29242bdb29 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:26.339986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:26.340935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.341221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.341498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] PATH_INFO: `/v3/users/f8ddd33ce55441fab31045bf155ccd7b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.342780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ddd33ce55441fab31045bf155ccd7b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:26.344850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:26.398437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ddd33ce55441fab31045bf155ccd7b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:26.407179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ddd33ce55441fab31045bf155ccd7b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:26.407804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ddd33ce55441fab31045bf155ccd7b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:26.415103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ddd33ce55441fab31045bf155ccd7b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:26.415775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ddd33ce55441fab31045bf155ccd7b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:26.433027 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1197/2379] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:26 2022] DELETE /identity/v3/users/f8ddd33ce55441fab31045bf155ccd7b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:26.438143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a0942-41f1-4a23-a927-1f693115e00c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.438599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a0942-41f1-4a23-a927-1f693115e00c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.438802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a0942-41f1-4a23-a927-1f693115e00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.458189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-404a0942-41f1-4a23-a927-1f693115e00c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:26.459455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-404a0942-41f1-4a23-a927-1f693115e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:26.525738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1183/2380] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:26.535375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.537241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:26.601181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d02bb1-bb2d-4d4e-b168-9df23fbc7805 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:26.605121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e7096-c596-4c84-8edb-8583245c79e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:26.605758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7096-c596-4c84-8edb-8583245c79e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.606039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7096-c596-4c84-8edb-8583245c79e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.606317 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7096-c596-4c84-8edb-8583245c79e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.615840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e7096-c596-4c84-8edb-8583245c79e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:26.617288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e7096-c596-4c84-8edb-8583245c79e1 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:26.627847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1198/2381] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:26.912979 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a0942-41f1-4a23-a927-1f693115e00c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.914554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-404a0942-41f1-4a23-a927-1f693115e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:26.928805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a0942-41f1-4a23-a927-1f693115e00c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:26.934838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:26.935774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.936081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.936320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] PATH_INFO: `/v3/projects/fedc51deb34d48e8b51968c9421b3d66` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.937619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedc51deb34d48e8b51968c9421b3d66)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:26.939573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:26.988609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedc51deb34d48e8b51968c9421b3d66', 'request_id': 'req-6b58e00e-9026-42da-b05f-14d011472783'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:26.996609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedc51deb34d48e8b51968c9421b3d66', 'request_id': 'req-6b58e00e-9026-42da-b05f-14d011472783'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.002825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedc51deb34d48e8b51968c9421b3d66', 'request_id': 'req-6b58e00e-9026-42da-b05f-14d011472783'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.013009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] The token cache is being invalidate because project fedc51deb34d48e8b51968c9421b3d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:27.013258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.013887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.015732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1184/2382] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:26 2022] DELETE /identity/v3/projects/fedc51deb34d48e8b51968c9421b3d66 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:24:27.019885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e7096-c596-4c84-8edb-8583245c79e1 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.030511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e7096-c596-4c84-8edb-8583245c79e1 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.040073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:27.096380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.097312 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.097594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.097911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] PATH_INFO: `/v3/users/e26ead587e34465a8c76fd866110844f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.099366 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26ead587e34465a8c76fd866110844f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.101498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.152035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26ead587e34465a8c76fd866110844f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.160117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26ead587e34465a8c76fd866110844f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.160770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26ead587e34465a8c76fd866110844f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.167973 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26ead587e34465a8c76fd866110844f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.168620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa8adcfe-b22c-483d-976b-d99dfded822e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26ead587e34465a8c76fd866110844f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.185926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1199/2383] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:27 2022] DELETE /identity/v3/users/e26ead587e34465a8c76fd866110844f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:27.476794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.478561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:27.493103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e00e-9026-42da-b05f-14d011472783 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.562310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.563606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.563935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.564288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] PATH_INFO: `/v3/projects/9f7fb41de9cb431781a496e586b90d4d` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.566367 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7fb41de9cb431781a496e586b90d4d)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.568976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.585887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:27.621361 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7fb41de9cb431781a496e586b90d4d', 'request_id': 'req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.630350 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7fb41de9cb431781a496e586b90d4d', 'request_id': 'req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.637140 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7fb41de9cb431781a496e586b90d4d', 'request_id': 'req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.650236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] The token cache is being invalidate because project 9f7fb41de9cb431781a496e586b90d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:27.650506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.651218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d1f9a55a-48bd-4e35-b3db-27d06429a7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:27.652950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1185/2384] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:27 2022] DELETE /identity/v3/projects/9f7fb41de9cb431781a496e586b90d4d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:27.658113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cae62-cc6d-42cf-9f20-1ab0203f982e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.658626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cae62-cc6d-42cf-9f20-1ab0203f982e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.658741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cae62-cc6d-42cf-9f20-1ab0203f982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.677685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-523cae62-cc6d-42cf-9f20-1ab0203f982e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:27.678547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-523cae62-cc6d-42cf-9f20-1ab0203f982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:27.741108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1200/2385] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:27.749070 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314eebe-da39-4846-9960-8f8d2fe917df None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.749355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314eebe-da39-4846-9960-8f8d2fe917df None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.749631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314eebe-da39-4846-9960-8f8d2fe917df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.769567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6314eebe-da39-4846-9960-8f8d2fe917df None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:27.770848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6314eebe-da39-4846-9960-8f8d2fe917df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:27.779402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1186/2386] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:27.783886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cae62-cc6d-42cf-9f20-1ab0203f982e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.794850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cae62-cc6d-42cf-9f20-1ab0203f982e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.799815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9489-2128-4a3f-a430-579db7da79cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.800487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9489-2128-4a3f-a430-579db7da79cc admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.800825 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9489-2128-4a3f-a430-579db7da79cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.801098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9489-2128-4a3f-a430-579db7da79cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.801825 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9489-2128-4a3f-a430-579db7da79cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:27.802193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9489-2128-4a3f-a430-579db7da79cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.803842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9489-2128-4a3f-a430-579db7da79cc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.816768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1201/2387] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:27.821211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314eebe-da39-4846-9960-8f8d2fe917df None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.830426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314eebe-da39-4846-9960-8f8d2fe917df None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.836031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60487e1-2a44-48b6-932c-a00603458e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.836690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60487e1-2a44-48b6-932c-a00603458e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.836998 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60487e1-2a44-48b6-932c-a00603458e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.837269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60487e1-2a44-48b6-932c-a00603458e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.837964 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60487e1-2a44-48b6-932c-a00603458e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.839859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60487e1-2a44-48b6-932c-a00603458e55 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.880002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1187/2388] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:27 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:27.885160 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9489-2128-4a3f-a430-579db7da79cc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.896080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9489-2128-4a3f-a430-579db7da79cc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.916502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:27.960870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d354e-5ca4-48c4-8110-3674213c8215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.961661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d354e-5ca4-48c4-8110-3674213c8215 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.961940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d354e-5ca4-48c4-8110-3674213c8215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.962210 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d354e-5ca4-48c4-8110-3674213c8215 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.962902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d354e-5ca4-48c4-8110-3674213c8215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.964840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d354e-5ca4-48c4-8110-3674213c8215 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.986333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1202/2389] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:27 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:27.990600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60487e1-2a44-48b6-932c-a00603458e55 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.001225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60487e1-2a44-48b6-932c-a00603458e55 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.006226 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57913c75-6fad-4b1e-98d9-9369d8f1704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.006973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57913c75-6fad-4b1e-98d9-9369d8f1704b admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.007322 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57913c75-6fad-4b1e-98d9-9369d8f1704b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.007663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57913c75-6fad-4b1e-98d9-9369d8f1704b admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.008496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57913c75-6fad-4b1e-98d9-9369d8f1704b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.010220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57913c75-6fad-4b1e-98d9-9369d8f1704b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.021713 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1188/2390] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:28.025838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d354e-5ca4-48c4-8110-3674213c8215 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.036479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d354e-5ca4-48c4-8110-3674213c8215 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.041694 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfada5-dfe0-4ce5-bacd-a7da9caee127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.042510 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfada5-dfe0-4ce5-bacd-a7da9caee127 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.042697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfada5-dfe0-4ce5-bacd-a7da9caee127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.042966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfada5-dfe0-4ce5-bacd-a7da9caee127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.043707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfada5-dfe0-4ce5-bacd-a7da9caee127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.045555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfada5-dfe0-4ce5-bacd-a7da9caee127 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.060745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1203/2391] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:24:28.061346 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57913c75-6fad-4b1e-98d9-9369d8f1704b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.071604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57913c75-6fad-4b1e-98d9-9369d8f1704b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.076220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595e5d3-6715-4e84-9fc1-59bcc66cc241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.077154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595e5d3-6715-4e84-9fc1-59bcc66cc241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.077433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595e5d3-6715-4e84-9fc1-59bcc66cc241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.077704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595e5d3-6715-4e84-9fc1-59bcc66cc241 admin admin] PATH_INFO: `/v3/projects/1a7f0be8d25446ddbc57352c1893dd0f/users/0628cf88b0a14380941454b3b5f691a6/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.092570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595e5d3-6715-4e84-9fc1-59bcc66cc241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7f0be8d25446ddbc57352c1893dd0f, user_id=0628cf88b0a14380941454b3b5f691a6, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.095305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595e5d3-6715-4e84-9fc1-59bcc66cc241 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.113065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1189/2392] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:28 2022] PUT /identity/v3/projects/1a7f0be8d25446ddbc57352c1893dd0f/users/0628cf88b0a14380941454b3b5f691a6/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:28.128439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16075c46-145b-4e3d-845d-861b97a50ed4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.128770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16075c46-145b-4e3d-845d-861b97a50ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.129074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16075c46-145b-4e3d-845d-861b97a50ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.158946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-16075c46-145b-4e3d-845d-861b97a50ed4 None None] MFA Rules not processed for user `0628cf88b0a14380941454b3b5f691a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:28.160261 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-16075c46-145b-4e3d-845d-861b97a50ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:28.225210 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1204/2393] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:28.229840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595e5d3-6715-4e84-9fc1-59bcc66cc241 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.294754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595e5d3-6715-4e84-9fc1-59bcc66cc241 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.299509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eeef8-9bdd-459b-9d4e-dd59b80fccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.300165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eeef8-9bdd-459b-9d4e-dd59b80fccb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.300461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eeef8-9bdd-459b-9d4e-dd59b80fccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.300765 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eeef8-9bdd-459b-9d4e-dd59b80fccb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.301469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eeef8-9bdd-459b-9d4e-dd59b80fccb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.303451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eeef8-9bdd-459b-9d4e-dd59b80fccb9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.330726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1190/2394] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:28 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:24:28.335105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16075c46-145b-4e3d-845d-861b97a50ed4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.347711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16075c46-145b-4e3d-845d-861b97a50ed4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.413636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfa5df-8028-4bbd-bf35-c905964f0d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.414322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfa5df-8028-4bbd-bf35-c905964f0d69 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.414605 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfa5df-8028-4bbd-bf35-c905964f0d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.414878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfa5df-8028-4bbd-bf35-c905964f0d69 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.415566 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfa5df-8028-4bbd-bf35-c905964f0d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.417562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfa5df-8028-4bbd-bf35-c905964f0d69 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.439109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1205/2395] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:28 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:28.443489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eeef8-9bdd-459b-9d4e-dd59b80fccb9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.454080 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eeef8-9bdd-459b-9d4e-dd59b80fccb9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.459492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feab98-b6cf-4ef7-b3f3-cd422100c0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.460159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feab98-b6cf-4ef7-b3f3-cd422100c0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.460549 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feab98-b6cf-4ef7-b3f3-cd422100c0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.460857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feab98-b6cf-4ef7-b3f3-cd422100c0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.461591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7feab98-b6cf-4ef7-b3f3-cd422100c0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.463191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7feab98-b6cf-4ef7-b3f3-cd422100c0d3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.474490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1191/2396] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:28.478704 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfa5df-8028-4bbd-bf35-c905964f0d69 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.489077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfa5df-8028-4bbd-bf35-c905964f0d69 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.498864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922487d6-37b3-4ca7-a03a-c72fee892dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.499827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922487d6-37b3-4ca7-a03a-c72fee892dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.500102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922487d6-37b3-4ca7-a03a-c72fee892dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.500372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922487d6-37b3-4ca7-a03a-c72fee892dc4 admin admin] PATH_INFO: `/v3/projects/5d4d929ddf474e3c918a16b332457017/users/f3f0870df60b47f984e7ed9cecad65ce/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.517611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922487d6-37b3-4ca7-a03a-c72fee892dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4d929ddf474e3c918a16b332457017, user_id=f3f0870df60b47f984e7ed9cecad65ce, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.520314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922487d6-37b3-4ca7-a03a-c72fee892dc4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.523492 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:28.539559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1206/2397] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:28 2022] PUT /identity/v3/projects/5d4d929ddf474e3c918a16b332457017/users/f3f0870df60b47f984e7ed9cecad65ce/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:28.543667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feab98-b6cf-4ef7-b3f3-cd422100c0d3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.554115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feab98-b6cf-4ef7-b3f3-cd422100c0d3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.563055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:28.613005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05779b26-8644-4752-b552-e6b8d6f3ffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.613700 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779b26-8644-4752-b552-e6b8d6f3ffc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.613984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779b26-8644-4752-b552-e6b8d6f3ffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.614274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779b26-8644-4752-b552-e6b8d6f3ffc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.615058 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05779b26-8644-4752-b552-e6b8d6f3ffc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.616714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05779b26-8644-4752-b552-e6b8d6f3ffc8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.627194 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1192/2398] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:28.631857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922487d6-37b3-4ca7-a03a-c72fee892dc4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.646718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922487d6-37b3-4ca7-a03a-c72fee892dc4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.653624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4bde2-28ca-407d-a064-10e8b0f04567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.654865 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4bde2-28ca-407d-a064-10e8b0f04567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.655149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4bde2-28ca-407d-a064-10e8b0f04567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.655421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4bde2-28ca-407d-a064-10e8b0f04567 admin admin] PATH_INFO: `/v3/projects/5d4d929ddf474e3c918a16b332457017/users/f3f0870df60b47f984e7ed9cecad65ce/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.657949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4bde2-28ca-407d-a064-10e8b0f04567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4d929ddf474e3c918a16b332457017, user_id=f3f0870df60b47f984e7ed9cecad65ce, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.662408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4bde2-28ca-407d-a064-10e8b0f04567 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.674199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1207/2399] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:28 2022] PUT /identity/v3/projects/5d4d929ddf474e3c918a16b332457017/users/f3f0870df60b47f984e7ed9cecad65ce/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:28.686067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9178-011a-451d-af45-769724d927ea None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.686363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9178-011a-451d-af45-769724d927ea None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.686648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9178-011a-451d-af45-769724d927ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.714336 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-93de9178-011a-451d-af45-769724d927ea None None] MFA Rules not processed for user `f3f0870df60b47f984e7ed9cecad65ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:28.715596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-93de9178-011a-451d-af45-769724d927ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:28.787618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1193/2400] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:28.800020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4bde2-28ca-407d-a064-10e8b0f04567 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.802267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f6b4bde2-28ca-407d-a064-10e8b0f04567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:28.868213 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4bde2-28ca-407d-a064-10e8b0f04567 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.874752 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26bcca-90f8-4c98-b30b-ada229862750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.875709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26bcca-90f8-4c98-b30b-ada229862750 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.876127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26bcca-90f8-4c98-b30b-ada229862750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.876711 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26bcca-90f8-4c98-b30b-ada229862750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.891607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26bcca-90f8-4c98-b30b-ada229862750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.893744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26bcca-90f8-4c98-b30b-ada229862750 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.904646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1208/2401] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:29.237698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de9178-011a-451d-af45-769724d927ea None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.246882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de9178-011a-451d-af45-769724d927ea None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.251648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022036f-a813-4890-bdc3-d06923859f51 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3f0870df60b47f984e7ed9cecad65ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d4d929ddf474e3c918a16b332457017', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.252364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022036f-a813-4890-bdc3-d06923859f51 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.252681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022036f-a813-4890-bdc3-d06923859f51 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.252984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022036f-a813-4890-bdc3-d06923859f51 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.253745 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022036f-a813-4890-bdc3-d06923859f51 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:29.254086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022036f-a813-4890-bdc3-d06923859f51 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.255739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022036f-a813-4890-bdc3-d06923859f51 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.268543 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1194/2402] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:29.272817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26bcca-90f8-4c98-b30b-ada229862750 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.282056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26bcca-90f8-4c98-b30b-ada229862750 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.286636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4177d7c-6639-4892-b6f8-0cb274b8738c tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3f0870df60b47f984e7ed9cecad65ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d4d929ddf474e3c918a16b332457017', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.287391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177d7c-6639-4892-b6f8-0cb274b8738c tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.287672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177d7c-6639-4892-b6f8-0cb274b8738c tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.287951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177d7c-6639-4892-b6f8-0cb274b8738c tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.288648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4177d7c-6639-4892-b6f8-0cb274b8738c tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.290562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4177d7c-6639-4892-b6f8-0cb274b8738c tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.320218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1209/2403] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:29 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:24:29.324968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022036f-a813-4890-bdc3-d06923859f51 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.334937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022036f-a813-4890-bdc3-d06923859f51 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.391670 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d1fe0-36df-45d8-ab03-a7ed559b345b tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3f0870df60b47f984e7ed9cecad65ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d4d929ddf474e3c918a16b332457017', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.392334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d1fe0-36df-45d8-ab03-a7ed559b345b tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.392619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d1fe0-36df-45d8-ab03-a7ed559b345b tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.392922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d1fe0-36df-45d8-ab03-a7ed559b345b tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.393651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d1fe0-36df-45d8-ab03-a7ed559b345b tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:29.393952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d1fe0-36df-45d8-ab03-a7ed559b345b tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.395545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d1fe0-36df-45d8-ab03-a7ed559b345b tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.407391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1195/2404] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:29.444222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4177d7c-6639-4892-b6f8-0cb274b8738c tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.455129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4177d7c-6639-4892-b6f8-0cb274b8738c tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.460934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3f0870df60b47f984e7ed9cecad65ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d4d929ddf474e3c918a16b332457017', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.461803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.462091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.462371 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] PATH_INFO: `/v3/projects/fdad0141c29745aaaf4e73811001d2c1` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.463595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fdad0141c29745aaaf4e73811001d2c1)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.465585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.524926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdad0141c29745aaaf4e73811001d2c1', 'request_id': 'req-3808f520-06a3-4060-b633-29e1960f5128'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:29.532342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdad0141c29745aaaf4e73811001d2c1', 'request_id': 'req-3808f520-06a3-4060-b633-29e1960f5128'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:29.543199 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdad0141c29745aaaf4e73811001d2c1', 'request_id': 'req-3808f520-06a3-4060-b633-29e1960f5128'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:29.557248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] The token cache is being invalidate because project fdad0141c29745aaaf4e73811001d2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:29.557529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:29.558175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3808f520-06a3-4060-b633-29e1960f5128 tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:29.559804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1210/2405] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:29 2022] DELETE /identity/v3/projects/fdad0141c29745aaaf4e73811001d2c1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:29.769394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d1fe0-36df-45d8-ab03-a7ed559b345b tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.771211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ef4d1fe0-36df-45d8-ab03-a7ed559b345b tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:29.790678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:29.839873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d1fe0-36df-45d8-ab03-a7ed559b345b tempest-VolumeQuotaClassesTest-407956892 tempest-VolumeQuotaClassesTest-407956892-project-admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.896358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.897333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.897610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.897895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] PATH_INFO: `/v3/users/0628cf88b0a14380941454b3b5f691a6` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.899114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0628cf88b0a14380941454b3b5f691a6)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.901092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.949715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0628cf88b0a14380941454b3b5f691a6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:29.949934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0628cf88b0a14380941454b3b5f691a6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:29.957783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0628cf88b0a14380941454b3b5f691a6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:29.965166 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0628cf88b0a14380941454b3b5f691a6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:29.965888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0628cf88b0a14380941454b3b5f691a6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:29.984260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1196/2406] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:29 2022] DELETE /identity/v3/users/0628cf88b0a14380941454b3b5f691a6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:29.988522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f7e1-baee-4407-b5e6-fdcea5199d42 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.989025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f7e1-baee-4407-b5e6-fdcea5199d42 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.989120 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f7e1-baee-4407-b5e6-fdcea5199d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.007859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2d64f7e1-baee-4407-b5e6-fdcea5199d42 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:30.009103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2d64f7e1-baee-4407-b5e6-fdcea5199d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:30.051995 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:30.073473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1211/2407] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:30.083300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:30.084879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:30.139174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:30.152770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420783e-ab17-4285-8706-c2b3571015c0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:30.157173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621218b-96fc-4afe-aff4-2b54994ace53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:30.157834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621218b-96fc-4afe-aff4-2b54994ace53 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.158123 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621218b-96fc-4afe-aff4-2b54994ace53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.158391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621218b-96fc-4afe-aff4-2b54994ace53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.167983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621218b-96fc-4afe-aff4-2b54994ace53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:30.169460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621218b-96fc-4afe-aff4-2b54994ace53 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:30.179209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1197/2408] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:30.481426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f7e1-baee-4407-b5e6-fdcea5199d42 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:30.483664 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2d64f7e1-baee-4407-b5e6-fdcea5199d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:30.498649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f7e1-baee-4407-b5e6-fdcea5199d42 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:30.504142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:30.505070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.505356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.505625 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] PATH_INFO: `/v3/projects/1a7f0be8d25446ddbc57352c1893dd0f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.506866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7f0be8d25446ddbc57352c1893dd0f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:30.508968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:30.565828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7f0be8d25446ddbc57352c1893dd0f', 'request_id': 'req-f6217b5b-324d-4251-917b-d7150616fdae'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:30.571861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7f0be8d25446ddbc57352c1893dd0f', 'request_id': 'req-f6217b5b-324d-4251-917b-d7150616fdae'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:30.579815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7f0be8d25446ddbc57352c1893dd0f', 'request_id': 'req-f6217b5b-324d-4251-917b-d7150616fdae'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:30.591123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] The token cache is being invalidate because project 1a7f0be8d25446ddbc57352c1893dd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:30.591412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:30.592080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:30.593672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1212/2409] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:30 2022] DELETE /identity/v3/projects/1a7f0be8d25446ddbc57352c1893dd0f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:30.597806 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621218b-96fc-4afe-aff4-2b54994ace53 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:30.608453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621218b-96fc-4afe-aff4-2b54994ace53 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:30.665137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:30.665931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.666210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.666483 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] PATH_INFO: `/v3/users/f3f0870df60b47f984e7ed9cecad65ce` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.667666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f0870df60b47f984e7ed9cecad65ce)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:30.669655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:30.714858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f0870df60b47f984e7ed9cecad65ce'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:30.715489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f0870df60b47f984e7ed9cecad65ce'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:30.722390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f0870df60b47f984e7ed9cecad65ce'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:30.729126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f0870df60b47f984e7ed9cecad65ce'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:30.729821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-261ab698-8bf4-4bf4-864c-9e30082b6cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f0870df60b47f984e7ed9cecad65ce'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:30.746266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1198/2410] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:30 2022] DELETE /identity/v3/users/f3f0870df60b47f984e7ed9cecad65ce => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:24:31.040084 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.041633 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:31.060982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6217b5b-324d-4251-917b-d7150616fdae admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.121320 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.122709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.123316 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.123781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] PATH_INFO: `/v3/projects/5d4d929ddf474e3c918a16b332457017` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.125666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4d929ddf474e3c918a16b332457017)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.128853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.191901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4d929ddf474e3c918a16b332457017', 'request_id': 'req-509334cc-aa0b-46cc-ac12-73cab436e08b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:31.198446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4d929ddf474e3c918a16b332457017', 'request_id': 'req-509334cc-aa0b-46cc-ac12-73cab436e08b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:31.208032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4d929ddf474e3c918a16b332457017', 'request_id': 'req-509334cc-aa0b-46cc-ac12-73cab436e08b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:31.216059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:31.221439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] The token cache is being invalidate because project 5d4d929ddf474e3c918a16b332457017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:31.222016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:31.222775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-509334cc-aa0b-46cc-ac12-73cab436e08b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:31.225333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1213/2411] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:31 2022] DELETE /identity/v3/projects/5d4d929ddf474e3c918a16b332457017 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:31.231033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09db6c1-9e2e-433e-9f05-6b9567441068 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.231562 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09db6c1-9e2e-433e-9f05-6b9567441068 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.231684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09db6c1-9e2e-433e-9f05-6b9567441068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.250655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d09db6c1-9e2e-433e-9f05-6b9567441068 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:31.251860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d09db6c1-9e2e-433e-9f05-6b9567441068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:31.315949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1199/2412] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:24:31.324883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49a47-40ed-4971-908d-6d2a179027dd None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.325218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49a47-40ed-4971-908d-6d2a179027dd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.325607 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49a47-40ed-4971-908d-6d2a179027dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.348980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-bed49a47-40ed-4971-908d-6d2a179027dd None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:31.350214 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bed49a47-40ed-4971-908d-6d2a179027dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:31.358991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1214/2413] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:31.363450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09db6c1-9e2e-433e-9f05-6b9567441068 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.369940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:31.374631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09db6c1-9e2e-433e-9f05-6b9567441068 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.381307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22bc75-0e55-456c-a26e-6d59011deeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.382250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22bc75-0e55-456c-a26e-6d59011deeca admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.382551 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22bc75-0e55-456c-a26e-6d59011deeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.383041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22bc75-0e55-456c-a26e-6d59011deeca admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.383908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22bc75-0e55-456c-a26e-6d59011deeca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:31.384216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22bc75-0e55-456c-a26e-6d59011deeca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.385839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22bc75-0e55-456c-a26e-6d59011deeca admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.398327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1200/2414] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:31.402739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49a47-40ed-4971-908d-6d2a179027dd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.412604 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49a47-40ed-4971-908d-6d2a179027dd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.417498 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09555d66-eafc-4044-94c1-6659298d7b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.418141 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555d66-eafc-4044-94c1-6659298d7b87 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.418418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555d66-eafc-4044-94c1-6659298d7b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.418690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555d66-eafc-4044-94c1-6659298d7b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.419381 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09555d66-eafc-4044-94c1-6659298d7b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.421293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09555d66-eafc-4044-94c1-6659298d7b87 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.449228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1215/2415] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:31 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:24:31.458647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22bc75-0e55-456c-a26e-6d59011deeca admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.468969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22bc75-0e55-456c-a26e-6d59011deeca admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.527768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ea2a9-2115-453b-8e81-b90694894b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.528455 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea2a9-2115-453b-8e81-b90694894b02 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.528798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea2a9-2115-453b-8e81-b90694894b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.529086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea2a9-2115-453b-8e81-b90694894b02 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.529802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ea2a9-2115-453b-8e81-b90694894b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.531824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ea2a9-2115-453b-8e81-b90694894b02 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.553684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1201/2416] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:31 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:31.558138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09555d66-eafc-4044-94c1-6659298d7b87 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.568902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09555d66-eafc-4044-94c1-6659298d7b87 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.573598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e19f-dcb4-455a-99d4-e19aad8fdae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.574259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e19f-dcb4-455a-99d4-e19aad8fdae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.574539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e19f-dcb4-455a-99d4-e19aad8fdae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.574807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e19f-dcb4-455a-99d4-e19aad8fdae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.575535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e19f-dcb4-455a-99d4-e19aad8fdae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.577258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e19f-dcb4-455a-99d4-e19aad8fdae9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.588152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1216/2417] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:31.592285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ea2a9-2115-453b-8e81-b90694894b02 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.602757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ea2a9-2115-453b-8e81-b90694894b02 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.608131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3e23d-31d2-4bbb-adb7-a674444cf2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.608842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3e23d-31d2-4bbb-adb7-a674444cf2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.609128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3e23d-31d2-4bbb-adb7-a674444cf2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.609400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3e23d-31d2-4bbb-adb7-a674444cf2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.610154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3e23d-31d2-4bbb-adb7-a674444cf2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.611746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3e23d-31d2-4bbb-adb7-a674444cf2b6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.622528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1202/2418] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:24:31.626751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e19f-dcb4-455a-99d4-e19aad8fdae9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.637358 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e19f-dcb4-455a-99d4-e19aad8fdae9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.643414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869efdb-d14e-4c77-a545-248eb85efb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.644332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869efdb-d14e-4c77-a545-248eb85efb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.644608 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869efdb-d14e-4c77-a545-248eb85efb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.645003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869efdb-d14e-4c77-a545-248eb85efb0e admin admin] PATH_INFO: `/v3/projects/585f48d95f45498390d8e1ee5396718e/users/2b62e10b61b64d7093be3f750f643c3a/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.662763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869efdb-d14e-4c77-a545-248eb85efb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=585f48d95f45498390d8e1ee5396718e, user_id=2b62e10b61b64d7093be3f750f643c3a, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.665506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869efdb-d14e-4c77-a545-248eb85efb0e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.680975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1217/2419] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:31 2022] PUT /identity/v3/projects/585f48d95f45498390d8e1ee5396718e/users/2b62e10b61b64d7093be3f750f643c3a/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:24:31.691317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fc35f-8768-4a18-83ca-1e441c88d103 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.691607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fc35f-8768-4a18-83ca-1e441c88d103 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.691884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fc35f-8768-4a18-83ca-1e441c88d103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.718760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-090fc35f-8768-4a18-83ca-1e441c88d103 None None] MFA Rules not processed for user `2b62e10b61b64d7093be3f750f643c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:31.719951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-090fc35f-8768-4a18-83ca-1e441c88d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:31.795357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1203/2420] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:31.799965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869efdb-d14e-4c77-a545-248eb85efb0e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.872119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869efdb-d14e-4c77-a545-248eb85efb0e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.877189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66ac25-b6fc-40c1-892c-a2dcc941a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.877850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66ac25-b6fc-40c1-892c-a2dcc941a425 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.878131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66ac25-b6fc-40c1-892c-a2dcc941a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.878404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66ac25-b6fc-40c1-892c-a2dcc941a425 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.879088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66ac25-b6fc-40c1-892c-a2dcc941a425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.881225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66ac25-b6fc-40c1-892c-a2dcc941a425 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.910555 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1218/2421] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:31 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:31.914927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fc35f-8768-4a18-83ca-1e441c88d103 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.926905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fc35f-8768-4a18-83ca-1e441c88d103 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.986690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00368-30d0-4451-9f5e-107ff92df968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.987301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00368-30d0-4451-9f5e-107ff92df968 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.987587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00368-30d0-4451-9f5e-107ff92df968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.987868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00368-30d0-4451-9f5e-107ff92df968 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.988586 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e00368-30d0-4451-9f5e-107ff92df968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.990755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e00368-30d0-4451-9f5e-107ff92df968 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.997438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:32.013373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1204/2422] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:31 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:32.018142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66ac25-b6fc-40c1-892c-a2dcc941a425 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:32.028844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66ac25-b6fc-40c1-892c-a2dcc941a425 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:32.033643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe18d2-b2bc-4e4c-ae94-40f111fe418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:32.034309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe18d2-b2bc-4e4c-ae94-40f111fe418e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.034596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe18d2-b2bc-4e4c-ae94-40f111fe418e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.034876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe18d2-b2bc-4e4c-ae94-40f111fe418e admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.035606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe18d2-b2bc-4e4c-ae94-40f111fe418e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:32.037412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe18d2-b2bc-4e4c-ae94-40f111fe418e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:32.048105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1219/2423] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:32.052396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00368-30d0-4451-9f5e-107ff92df968 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:32.063191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00368-30d0-4451-9f5e-107ff92df968 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:32.067852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831affa-2181-459d-a3bd-b4eb2adc687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:32.068835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831affa-2181-459d-a3bd-b4eb2adc687a admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.069112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831affa-2181-459d-a3bd-b4eb2adc687a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.069401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831affa-2181-459d-a3bd-b4eb2adc687a admin admin] PATH_INFO: `/v3/projects/333c685fc6c74e5298421082f5bc856b/users/02583853d9e742c196c60130c1b15014/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.084677 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831affa-2181-459d-a3bd-b4eb2adc687a admin admin] RBAC: Authorizing `identity:create_grant(project_id=333c685fc6c74e5298421082f5bc856b, user_id=02583853d9e742c196c60130c1b15014, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:32.087429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831affa-2181-459d-a3bd-b4eb2adc687a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:32.101796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1205/2424] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:32 2022] PUT /identity/v3/projects/333c685fc6c74e5298421082f5bc856b/users/02583853d9e742c196c60130c1b15014/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:32.105820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe18d2-b2bc-4e4c-ae94-40f111fe418e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:32.116069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe18d2-b2bc-4e4c-ae94-40f111fe418e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:32.175906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339e86e-8a16-4641-885e-28724cffcea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:32.176583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339e86e-8a16-4641-885e-28724cffcea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.176911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339e86e-8a16-4641-885e-28724cffcea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.177184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339e86e-8a16-4641-885e-28724cffcea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.177986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339e86e-8a16-4641-885e-28724cffcea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:32.179572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339e86e-8a16-4641-885e-28724cffcea7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:32.189588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1220/2425] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:32.194126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831affa-2181-459d-a3bd-b4eb2adc687a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:32.205064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831affa-2181-459d-a3bd-b4eb2adc687a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:32.210408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be371fd-46e4-4652-867e-02599b4c2122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:32.211302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be371fd-46e4-4652-867e-02599b4c2122 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.211588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be371fd-46e4-4652-867e-02599b4c2122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.211880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be371fd-46e4-4652-867e-02599b4c2122 admin admin] PATH_INFO: `/v3/projects/333c685fc6c74e5298421082f5bc856b/users/02583853d9e742c196c60130c1b15014/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.213906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be371fd-46e4-4652-867e-02599b4c2122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333c685fc6c74e5298421082f5bc856b, user_id=02583853d9e742c196c60130c1b15014, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:32.216586 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be371fd-46e4-4652-867e-02599b4c2122 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:32.227704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1206/2426] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:32 2022] PUT /identity/v3/projects/333c685fc6c74e5298421082f5bc856b/users/02583853d9e742c196c60130c1b15014/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:32.238966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3900d-96cc-4dc9-8367-06086160838e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.239194 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3900d-96cc-4dc9-8367-06086160838e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.239466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3900d-96cc-4dc9-8367-06086160838e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.246857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:32.267487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-aba3900d-96cc-4dc9-8367-06086160838e None None] MFA Rules not processed for user `02583853d9e742c196c60130c1b15014`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:32.268784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-aba3900d-96cc-4dc9-8367-06086160838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:32.340032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1221/2427] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:32.351005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be371fd-46e4-4652-867e-02599b4c2122 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:32.352939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9be371fd-46e4-4652-867e-02599b4c2122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:32.418900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be371fd-46e4-4652-867e-02599b4c2122 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:32.423596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a2d02-7856-4456-a65f-95e38669226c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:32.424262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2d02-7856-4456-a65f-95e38669226c service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.424540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2d02-7856-4456-a65f-95e38669226c service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.424845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2d02-7856-4456-a65f-95e38669226c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.435127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a2d02-7856-4456-a65f-95e38669226c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:32.436602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a2d02-7856-4456-a65f-95e38669226c service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:32.446600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1207/2428] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:32.866078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3900d-96cc-4dc9-8367-06086160838e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:32.942356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3900d-96cc-4dc9-8367-06086160838e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:32.953587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:32.954707 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.955036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.955318 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] PATH_INFO: `/v3/users/2b62e10b61b64d7093be3f750f643c3a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.956961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b62e10b61b64d7093be3f750f643c3a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:32.959014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:33.012422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b62e10b61b64d7093be3f750f643c3a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.021841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b62e10b61b64d7093be3f750f643c3a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.022541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b62e10b61b64d7093be3f750f643c3a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.030033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b62e10b61b64d7093be3f750f643c3a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.030750 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b62e10b61b64d7093be3f750f643c3a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.048504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1222/2429] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:32 2022] DELETE /identity/v3/users/2b62e10b61b64d7093be3f750f643c3a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:33.053404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e99b-1f1b-4397-907a-9332a5e89dba None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.053663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e99b-1f1b-4397-907a-9332a5e89dba None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.053901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e99b-1f1b-4397-907a-9332a5e89dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.072341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e594e99b-1f1b-4397-907a-9332a5e89dba None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:33.073566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e594e99b-1f1b-4397-907a-9332a5e89dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:33.139111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1208/2430] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:24:33.149535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.150977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:33.162120 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:33.211507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3ca1d-5b81-49e7-969b-745320102ca4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.215305 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094aaec-1736-430b-9fa2-94082147f9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:33.215953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094aaec-1736-430b-9fa2-94082147f9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.216247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094aaec-1736-430b-9fa2-94082147f9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.216618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094aaec-1736-430b-9fa2-94082147f9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.226373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094aaec-1736-430b-9fa2-94082147f9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:33.227567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094aaec-1736-430b-9fa2-94082147f9f3 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:33.237763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1223/2431] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:33.536763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e99b-1f1b-4397-907a-9332a5e89dba None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.538588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e594e99b-1f1b-4397-907a-9332a5e89dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:33.554658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e99b-1f1b-4397-907a-9332a5e89dba None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.560521 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:33.561575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.562124 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.562252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] PATH_INFO: `/v3/projects/585f48d95f45498390d8e1ee5396718e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.563522 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=585f48d95f45498390d8e1ee5396718e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:33.565607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:33.625463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585f48d95f45498390d8e1ee5396718e', 'request_id': 'req-38a1e473-7b4c-43df-b777-abeffa34e8b0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.627171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:33.635454 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585f48d95f45498390d8e1ee5396718e', 'request_id': 'req-38a1e473-7b4c-43df-b777-abeffa34e8b0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.643320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585f48d95f45498390d8e1ee5396718e', 'request_id': 'req-38a1e473-7b4c-43df-b777-abeffa34e8b0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.654421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] The token cache is being invalidate because project 585f48d95f45498390d8e1ee5396718e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:33.654712 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.655431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.657206 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1209/2432] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:33 2022] DELETE /identity/v3/projects/585f48d95f45498390d8e1ee5396718e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:33.663193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094aaec-1736-430b-9fa2-94082147f9f3 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.673014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094aaec-1736-430b-9fa2-94082147f9f3 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.734285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:33.735175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.735461 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.735740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] PATH_INFO: `/v3/users/02583853d9e742c196c60130c1b15014` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.737001 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02583853d9e742c196c60130c1b15014)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:33.738939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:33.791971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02583853d9e742c196c60130c1b15014'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.800043 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02583853d9e742c196c60130c1b15014'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.800705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02583853d9e742c196c60130c1b15014'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.808288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02583853d9e742c196c60130c1b15014'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.809031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cd03c9d5-2d36-4a1d-a078-d3bc54b5dc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02583853d9e742c196c60130c1b15014'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:33.826379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1224/2433] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:33 2022] DELETE /identity/v3/users/02583853d9e742c196c60130c1b15014 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:34.171208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.172854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:34.186189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1e473-7b4c-43df-b777-abeffa34e8b0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.244458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.245360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.245641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.245914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] PATH_INFO: `/v3/projects/333c685fc6c74e5298421082f5bc856b` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.247109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=333c685fc6c74e5298421082f5bc856b)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.249085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.301800 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333c685fc6c74e5298421082f5bc856b', 'request_id': 'req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:34.309593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333c685fc6c74e5298421082f5bc856b', 'request_id': 'req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:34.315981 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333c685fc6c74e5298421082f5bc856b', 'request_id': 'req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:34.326283 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] The token cache is being invalidate because project 333c685fc6c74e5298421082f5bc856b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:34.326569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:34.327231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b68f93a9-c7e5-4eeb-8282-7b620f1d6915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:34.328845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1210/2434] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:34 2022] DELETE /identity/v3/projects/333c685fc6c74e5298421082f5bc856b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:34.334517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d0ae1-9724-4044-894a-aa5b934f1350 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.335006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d0ae1-9724-4044-894a-aa5b934f1350 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.335108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d0ae1-9724-4044-894a-aa5b934f1350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.352912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ea0d0ae1-9724-4044-894a-aa5b934f1350 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:34.354118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ea0d0ae1-9724-4044-894a-aa5b934f1350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:34.381114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:34.420150 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1225/2435] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:34.428192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0882-79b4-4990-9007-07f6ffe08d9e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.428452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0882-79b4-4990-9007-07f6ffe08d9e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.428788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0882-79b4-4990-9007-07f6ffe08d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.449113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-300d0882-79b4-4990-9007-07f6ffe08d9e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:34.450325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-300d0882-79b4-4990-9007-07f6ffe08d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:34.459693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1211/2436] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:24:34.464131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d0ae1-9724-4044-894a-aa5b934f1350 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.483370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d0ae1-9724-4044-894a-aa5b934f1350 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.488848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48ec94-4ff1-41c6-af2e-9e1f32b6202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.489638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ec94-4ff1-41c6-af2e-9e1f32b6202c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.490054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ec94-4ff1-41c6-af2e-9e1f32b6202c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.490393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ec94-4ff1-41c6-af2e-9e1f32b6202c admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.491125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ec94-4ff1-41c6-af2e-9e1f32b6202c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:34.491428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ec94-4ff1-41c6-af2e-9e1f32b6202c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.493094 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ec94-4ff1-41c6-af2e-9e1f32b6202c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.505591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1226/2437] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:34.510359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d0882-79b4-4990-9007-07f6ffe08d9e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.519503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d0882-79b4-4990-9007-07f6ffe08d9e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.524246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d708-efda-439b-b238-adfe12134ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.525294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d708-efda-439b-b238-adfe12134ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.525576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d708-efda-439b-b238-adfe12134ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.525849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d708-efda-439b-b238-adfe12134ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.526925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2d708-efda-439b-b238-adfe12134ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.528440 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2d708-efda-439b-b238-adfe12134ce5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.554642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1212/2438] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:34 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:34.558675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48ec94-4ff1-41c6-af2e-9e1f32b6202c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.568989 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48ec94-4ff1-41c6-af2e-9e1f32b6202c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.635547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799bde-3d62-4f5c-8029-d60d7f37dbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.636259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799bde-3d62-4f5c-8029-d60d7f37dbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.636544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799bde-3d62-4f5c-8029-d60d7f37dbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.636850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799bde-3d62-4f5c-8029-d60d7f37dbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.637639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9799bde-3d62-4f5c-8029-d60d7f37dbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.639875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9799bde-3d62-4f5c-8029-d60d7f37dbd4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.667263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1227/2439] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:34 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:34.668376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d708-efda-439b-b238-adfe12134ce5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.681822 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d708-efda-439b-b238-adfe12134ce5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.686574 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c0d79-de39-4b3e-83bd-5e0a632dc415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.687362 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c0d79-de39-4b3e-83bd-5e0a632dc415 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.687651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c0d79-de39-4b3e-83bd-5e0a632dc415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.687928 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c0d79-de39-4b3e-83bd-5e0a632dc415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.688686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c0d79-de39-4b3e-83bd-5e0a632dc415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.690355 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c0d79-de39-4b3e-83bd-5e0a632dc415 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.701552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1213/2440] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:24:34.706010 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799bde-3d62-4f5c-8029-d60d7f37dbd4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.717393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799bde-3d62-4f5c-8029-d60d7f37dbd4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.722413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b227c63-6f0d-46c0-a190-bd2d8e14a54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.723087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b227c63-6f0d-46c0-a190-bd2d8e14a54c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.723373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b227c63-6f0d-46c0-a190-bd2d8e14a54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.723647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b227c63-6f0d-46c0-a190-bd2d8e14a54c admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.724570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b227c63-6f0d-46c0-a190-bd2d8e14a54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.726050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b227c63-6f0d-46c0-a190-bd2d8e14a54c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.739314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1228/2441] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:34.743266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c0d79-de39-4b3e-83bd-5e0a632dc415 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.757834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c0d79-de39-4b3e-83bd-5e0a632dc415 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.763204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b34d3-6c0f-40ac-a186-ccacfd115842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.764119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b34d3-6c0f-40ac-a186-ccacfd115842 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.764398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b34d3-6c0f-40ac-a186-ccacfd115842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.765009 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b34d3-6c0f-40ac-a186-ccacfd115842 admin admin] PATH_INFO: `/v3/projects/9577c8f3649b49e0b505de7849e54609/users/3dbef645a6db47578e157c5ff998ca9d/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.782251 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b34d3-6c0f-40ac-a186-ccacfd115842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9577c8f3649b49e0b505de7849e54609, user_id=3dbef645a6db47578e157c5ff998ca9d, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.784980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b34d3-6c0f-40ac-a186-ccacfd115842 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.804821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1214/2442] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:34 2022] PUT /identity/v3/projects/9577c8f3649b49e0b505de7849e54609/users/3dbef645a6db47578e157c5ff998ca9d/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:34.815919 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06fae8-1594-4e0a-a114-6ec758920b30 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.816216 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06fae8-1594-4e0a-a114-6ec758920b30 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.816499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06fae8-1594-4e0a-a114-6ec758920b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.847391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2e06fae8-1594-4e0a-a114-6ec758920b30 None None] MFA Rules not processed for user `3dbef645a6db47578e157c5ff998ca9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:34.848586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2e06fae8-1594-4e0a-a114-6ec758920b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:34.914588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1229/2443] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:34.919252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b34d3-6c0f-40ac-a186-ccacfd115842 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.925734 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:34.988412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b34d3-6c0f-40ac-a186-ccacfd115842 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.994360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838a888-4f42-40fd-9c50-7215036a1082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.995028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838a888-4f42-40fd-9c50-7215036a1082 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.995314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838a888-4f42-40fd-9c50-7215036a1082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.995589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838a888-4f42-40fd-9c50-7215036a1082 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.996294 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838a888-4f42-40fd-9c50-7215036a1082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.998242 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838a888-4f42-40fd-9c50-7215036a1082 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:35.031008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1215/2444] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:34 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:35.032245 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06fae8-1594-4e0a-a114-6ec758920b30 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.044875 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06fae8-1594-4e0a-a114-6ec758920b30 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.080511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:35.131774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849de4f-a9b4-4478-b390-66e99587a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.132543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849de4f-a9b4-4478-b390-66e99587a010 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.132868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849de4f-a9b4-4478-b390-66e99587a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.133144 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849de4f-a9b4-4478-b390-66e99587a010 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.133887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849de4f-a9b4-4478-b390-66e99587a010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:35.135912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849de4f-a9b4-4478-b390-66e99587a010 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:35.159983 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1230/2445] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:35 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:35.164423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838a888-4f42-40fd-9c50-7215036a1082 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.176374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838a888-4f42-40fd-9c50-7215036a1082 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.182400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3755a60-deb9-49ee-a538-4e3c804e18d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.183108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3755a60-deb9-49ee-a538-4e3c804e18d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.183387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3755a60-deb9-49ee-a538-4e3c804e18d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.183650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3755a60-deb9-49ee-a538-4e3c804e18d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.184405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3755a60-deb9-49ee-a538-4e3c804e18d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:35.186063 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3755a60-deb9-49ee-a538-4e3c804e18d4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:35.198331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1216/2446] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:35.202881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849de4f-a9b4-4478-b390-66e99587a010 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.213609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849de4f-a9b4-4478-b390-66e99587a010 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.220365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc179052-5319-4a25-b036-f6910003759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.221311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc179052-5319-4a25-b036-f6910003759e admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.221597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc179052-5319-4a25-b036-f6910003759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.221873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc179052-5319-4a25-b036-f6910003759e admin admin] PATH_INFO: `/v3/projects/7b7ab8c7098b4d1b854e574a77d94407/users/f0f050515fce43369012c90ad9904a64/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.237623 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc179052-5319-4a25-b036-f6910003759e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7ab8c7098b4d1b854e574a77d94407, user_id=f0f050515fce43369012c90ad9904a64, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:35.240379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc179052-5319-4a25-b036-f6910003759e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:35.254981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1231/2447] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:35 2022] PUT /identity/v3/projects/7b7ab8c7098b4d1b854e574a77d94407/users/f0f050515fce43369012c90ad9904a64/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:24:35.258973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3755a60-deb9-49ee-a538-4e3c804e18d4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.270541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3755a60-deb9-49ee-a538-4e3c804e18d4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.343916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290a95a-0ac4-4337-b1cd-f4e7236e590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.344545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290a95a-0ac4-4337-b1cd-f4e7236e590b admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.344869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290a95a-0ac4-4337-b1cd-f4e7236e590b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.345144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290a95a-0ac4-4337-b1cd-f4e7236e590b admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.345878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290a95a-0ac4-4337-b1cd-f4e7236e590b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:35.347572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290a95a-0ac4-4337-b1cd-f4e7236e590b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:35.357988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1217/2448] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:35.363164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc179052-5319-4a25-b036-f6910003759e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.373868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc179052-5319-4a25-b036-f6910003759e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.379168 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590f963-79f6-4b40-b629-e103ef755043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.379602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590f963-79f6-4b40-b629-e103ef755043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.379888 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590f963-79f6-4b40-b629-e103ef755043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.380171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590f963-79f6-4b40-b629-e103ef755043 admin admin] PATH_INFO: `/v3/projects/7b7ab8c7098b4d1b854e574a77d94407/users/f0f050515fce43369012c90ad9904a64/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.382250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590f963-79f6-4b40-b629-e103ef755043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7ab8c7098b4d1b854e574a77d94407, user_id=f0f050515fce43369012c90ad9904a64, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:35.384950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590f963-79f6-4b40-b629-e103ef755043 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:35.395563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1232/2449] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:35 2022] PUT /identity/v3/projects/7b7ab8c7098b4d1b854e574a77d94407/users/f0f050515fce43369012c90ad9904a64/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:35.461264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0714f-5f86-4492-8ec1-9dc2b89f57c9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.461510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0714f-5f86-4492-8ec1-9dc2b89f57c9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.461815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0714f-5f86-4492-8ec1-9dc2b89f57c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.492901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-52d0714f-5f86-4492-8ec1-9dc2b89f57c9 None None] MFA Rules not processed for user `f0f050515fce43369012c90ad9904a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:35.494135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-52d0714f-5f86-4492-8ec1-9dc2b89f57c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:35.572531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:35.578372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1218/2450] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:35.589738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590f963-79f6-4b40-b629-e103ef755043 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.591797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d590f963-79f6-4b40-b629-e103ef755043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:35.654810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590f963-79f6-4b40-b629-e103ef755043 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.659195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8717311-13e9-4e62-a14b-30418b1ade73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.659856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8717311-13e9-4e62-a14b-30418b1ade73 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.660143 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8717311-13e9-4e62-a14b-30418b1ade73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.660419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8717311-13e9-4e62-a14b-30418b1ade73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.724223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8717311-13e9-4e62-a14b-30418b1ade73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:35.725884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8717311-13e9-4e62-a14b-30418b1ade73 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:35.735843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1233/2451] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:38.278888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0714f-5f86-4492-8ec1-9dc2b89f57c9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.350154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0714f-5f86-4492-8ec1-9dc2b89f57c9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.354969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.355863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.356142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.356411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] PATH_INFO: `/v3/users/3dbef645a6db47578e157c5ff998ca9d` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.357657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dbef645a6db47578e157c5ff998ca9d)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.359617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.412110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbef645a6db47578e157c5ff998ca9d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:38.412785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbef645a6db47578e157c5ff998ca9d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:38.421516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbef645a6db47578e157c5ff998ca9d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:38.429269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbef645a6db47578e157c5ff998ca9d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:38.429982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbef645a6db47578e157c5ff998ca9d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:38.456450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1219/2452] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:38 2022] DELETE /identity/v3/users/3dbef645a6db47578e157c5ff998ca9d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:38.462193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd71d72-3680-4208-8075-84facff631ea None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.462577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd71d72-3680-4208-8075-84facff631ea None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.462951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd71d72-3680-4208-8075-84facff631ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.483656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6cd71d72-3680-4208-8075-84facff631ea None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:38.485286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6cd71d72-3680-4208-8075-84facff631ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:38.520630 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:38.570813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1234/2453] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:38.581408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.583021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:38.620980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c189e5-8b2c-410b-8338-0c616410b5ea None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.621274 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c189e5-8b2c-410b-8338-0c616410b5ea None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.621556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c189e5-8b2c-410b-8338-0c616410b5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.643365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d7c189e5-8b2c-410b-8338-0c616410b5ea None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:38.644588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d7c189e5-8b2c-410b-8338-0c616410b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:38.661899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1a456-df17-4493-bd01-2701074eb3f9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.666139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f229c3a-7051-439f-9ed5-4925f466d118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.666894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229c3a-7051-439f-9ed5-4925f466d118 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.667212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229c3a-7051-439f-9ed5-4925f466d118 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.667550 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229c3a-7051-439f-9ed5-4925f466d118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.679572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f229c3a-7051-439f-9ed5-4925f466d118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.681135 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f229c3a-7051-439f-9ed5-4925f466d118 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.691619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1220/2454] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:38.715793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1235/2455] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:24:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:24:38.729812 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f229c3a-7051-439f-9ed5-4925f466d118 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.731228 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7f229c3a-7051-439f-9ed5-4925f466d118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:38.771623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:38.850290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f229c3a-7051-439f-9ed5-4925f466d118 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.856415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12370c-947f-47e5-886d-70b21a5328e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.857538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12370c-947f-47e5-886d-70b21a5328e4 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.857895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12370c-947f-47e5-886d-70b21a5328e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.858633 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12370c-947f-47e5-886d-70b21a5328e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.870218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12370c-947f-47e5-886d-70b21a5328e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.872396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12370c-947f-47e5-886d-70b21a5328e4 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.886019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1221/2456] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:24:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:24:39.096127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c189e5-8b2c-410b-8338-0c616410b5ea None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:39.098122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d7c189e5-8b2c-410b-8338-0c616410b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:39.125131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c189e5-8b2c-410b-8338-0c616410b5ea None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:39.136054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:39.137728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:39.138162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:39.139320 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] PATH_INFO: `/v3/projects/9577c8f3649b49e0b505de7849e54609` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:39.141767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9577c8f3649b49e0b505de7849e54609)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:39.144056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:39.222804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9577c8f3649b49e0b505de7849e54609', 'request_id': 'req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:39.228915 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9577c8f3649b49e0b505de7849e54609', 'request_id': 'req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:39.244062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9577c8f3649b49e0b505de7849e54609', 'request_id': 'req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:39.261386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] The token cache is being invalidate because project 9577c8f3649b49e0b505de7849e54609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:39.261980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:39.262814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:39.269155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1236/2457] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:39 2022] DELETE /identity/v3/projects/9577c8f3649b49e0b505de7849e54609 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:39.270731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12370c-947f-47e5-886d-70b21a5328e4 service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:39.291169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12370c-947f-47e5-886d-70b21a5328e4 service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:39.405646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:39.406880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:39.407274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:39.407554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] PATH_INFO: `/v3/users/f0f050515fce43369012c90ad9904a64` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:39.408882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f050515fce43369012c90ad9904a64)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:39.411118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:39.501726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f050515fce43369012c90ad9904a64'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:39.503065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f050515fce43369012c90ad9904a64'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:39.521387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f050515fce43369012c90ad9904a64'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:39.535570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f050515fce43369012c90ad9904a64'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:39.537071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f050515fce43369012c90ad9904a64'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:39.563984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:39.566619 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:39.572560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1222/2458] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:24:39 2022] DELETE /identity/v3/users/f0f050515fce43369012c90ad9904a64 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:24:39.760011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:39.792481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d03e-81c5-4f77-99cb-9470e8f4e4b3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:39.899583 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196119e-da81-4aa5-bb26-304ea51a41e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:39.900598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196119e-da81-4aa5-bb26-304ea51a41e4 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:39.900914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196119e-da81-4aa5-bb26-304ea51a41e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:39.901552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196119e-da81-4aa5-bb26-304ea51a41e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:39.904438 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d196119e-da81-4aa5-bb26-304ea51a41e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:39.918666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196119e-da81-4aa5-bb26-304ea51a41e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:39.920303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196119e-da81-4aa5-bb26-304ea51a41e4 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:39.933293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1237/2459] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:39.974066 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:39.976470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:40.045323 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:40.091102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4725d-a043-41e5-ae72-9e6564a1d974 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:40.095752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:40.096632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.096943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.097351 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] PATH_INFO: `/v3/projects/7b7ab8c7098b4d1b854e574a77d94407` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:40.098861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7ab8c7098b4d1b854e574a77d94407)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:40.101576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:40.175387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7ab8c7098b4d1b854e574a77d94407', 'request_id': 'req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:40.187158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7ab8c7098b4d1b854e574a77d94407', 'request_id': 'req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:40.198887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7ab8c7098b4d1b854e574a77d94407', 'request_id': 'req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:40.228858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] The token cache is being invalidate because project 7b7ab8c7098b4d1b854e574a77d94407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:24:40.228858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:40.228858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2653c1e7-5c4d-47db-9f4a-40aa59cf728b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:24:40.228858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1223/2460] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:24:39 2022] DELETE /identity/v3/projects/7b7ab8c7098b4d1b854e574a77d94407 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:40.231016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5be26-7c4b-4631-9685-9bec29c83d51 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.231338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5be26-7c4b-4631-9685-9bec29c83d51 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.231617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5be26-7c4b-4631-9685-9bec29c83d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:40.252282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5db5be26-7c4b-4631-9685-9bec29c83d51 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:40.253539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5db5be26-7c4b-4631-9685-9bec29c83d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:40.344482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1238/2461] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:40.352164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07319e-d805-4fd5-bebc-158fa48d8c10 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.352748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07319e-d805-4fd5-bebc-158fa48d8c10 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.352920 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07319e-d805-4fd5-bebc-158fa48d8c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:40.375866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5a07319e-d805-4fd5-bebc-158fa48d8c10 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:40.377757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5a07319e-d805-4fd5-bebc-158fa48d8c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:40.392395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5be26-7c4b-4631-9685-9bec29c83d51 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:40.394493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1224/2462] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:40.406796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5be26-7c4b-4631-9685-9bec29c83d51 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:40.411798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2d39-a685-4629-aa5a-c8dc6349a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:40.412760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2d39-a685-4629-aa5a-c8dc6349a2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.413014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2d39-a685-4629-aa5a-c8dc6349a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.413288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2d39-a685-4629-aa5a-c8dc6349a2a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:40.414023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d2d39-a685-4629-aa5a-c8dc6349a2a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:40.414326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d2d39-a685-4629-aa5a-c8dc6349a2a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:40.416319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d2d39-a685-4629-aa5a-c8dc6349a2a6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:40.433778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1239/2463] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:40.438750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07319e-d805-4fd5-bebc-158fa48d8c10 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:40.450932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07319e-d805-4fd5-bebc-158fa48d8c10 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:40.456621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ff0d-0832-46c6-ba56-8716f43bac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:40.457757 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ff0d-0832-46c6-ba56-8716f43bac52 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.458198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ff0d-0832-46c6-ba56-8716f43bac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.458795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ff0d-0832-46c6-ba56-8716f43bac52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:40.459515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020ff0d-0832-46c6-ba56-8716f43bac52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:40.461651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020ff0d-0832-46c6-ba56-8716f43bac52 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:40.507237 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1225/2464] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:24:40 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:40.509507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2d39-a685-4629-aa5a-c8dc6349a2a6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:40.523560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2d39-a685-4629-aa5a-c8dc6349a2a6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:40.599671 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fbca7-074e-4fb5-b985-135ea9f7273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:40.600329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fbca7-074e-4fb5-b985-135ea9f7273a admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.600565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fbca7-074e-4fb5-b985-135ea9f7273a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.600873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fbca7-074e-4fb5-b985-135ea9f7273a admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:40.601715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fbca7-074e-4fb5-b985-135ea9f7273a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:40.607193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fbca7-074e-4fb5-b985-135ea9f7273a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:40.637908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1240/2465] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:24:40 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:40.642217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ff0d-0832-46c6-ba56-8716f43bac52 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:40.653567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ff0d-0832-46c6-ba56-8716f43bac52 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:40.658495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37397611-204a-4ccf-a5fc-7c90b00e6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:40.659170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37397611-204a-4ccf-a5fc-7c90b00e6b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.659449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37397611-204a-4ccf-a5fc-7c90b00e6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.659724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37397611-204a-4ccf-a5fc-7c90b00e6b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:40.660456 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37397611-204a-4ccf-a5fc-7c90b00e6b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:40.662177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37397611-204a-4ccf-a5fc-7c90b00e6b55 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:40.674584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1226/2466] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:40.679185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fbca7-074e-4fb5-b985-135ea9f7273a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:40.685267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:40.692155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fbca7-074e-4fb5-b985-135ea9f7273a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:40.699087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a14149-a130-45d8-a171-7f5321a94c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:40.699759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a14149-a130-45d8-a171-7f5321a94c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.700080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a14149-a130-45d8-a171-7f5321a94c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.700355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a14149-a130-45d8-a171-7f5321a94c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:40.701113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a14149-a130-45d8-a171-7f5321a94c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:40.704231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a14149-a130-45d8-a171-7f5321a94c7e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:40.715462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1241/2467] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:24:40.719751 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37397611-204a-4ccf-a5fc-7c90b00e6b55 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:40.730854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37397611-204a-4ccf-a5fc-7c90b00e6b55 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:40.735743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f14c9-af2b-4c7b-93f8-4fb078c41459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:40.736695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f14c9-af2b-4c7b-93f8-4fb078c41459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.736991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f14c9-af2b-4c7b-93f8-4fb078c41459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.737267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f14c9-af2b-4c7b-93f8-4fb078c41459 admin admin] PATH_INFO: `/v3/projects/b9e5fd23aefc48649bc9a5f60abd79dd/users/2e38f3de325f4346916388df3f59c512/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:40.756309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f14c9-af2b-4c7b-93f8-4fb078c41459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e5fd23aefc48649bc9a5f60abd79dd, user_id=2e38f3de325f4346916388df3f59c512, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:40.759198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f14c9-af2b-4c7b-93f8-4fb078c41459 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:40.778961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1227/2468] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:24:40 2022] PUT /identity/v3/projects/b9e5fd23aefc48649bc9a5f60abd79dd/users/2e38f3de325f4346916388df3f59c512/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:40.790242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c128-2c79-4e54-815b-e231e38896b9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.790534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c128-2c79-4e54-815b-e231e38896b9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.790817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c128-2c79-4e54-815b-e231e38896b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:40.819242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2293c128-2c79-4e54-815b-e231e38896b9 None None] MFA Rules not processed for user `2e38f3de325f4346916388df3f59c512`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:40.820772 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2293c128-2c79-4e54-815b-e231e38896b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:40.905496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1242/2469] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:24:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:40.912647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f14c9-af2b-4c7b-93f8-4fb078c41459 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:40.915156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-411f14c9-af2b-4c7b-93f8-4fb078c41459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:40.985852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f14c9-af2b-4c7b-93f8-4fb078c41459 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:40.990540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98c240-1745-4b50-91da-56805d523669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:40.991429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98c240-1745-4b50-91da-56805d523669 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:40.991901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98c240-1745-4b50-91da-56805d523669 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:40.992330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98c240-1745-4b50-91da-56805d523669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:41.004379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98c240-1745-4b50-91da-56805d523669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:41.006611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98c240-1745-4b50-91da-56805d523669 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:41.012537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:41.020620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1228/2470] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:24:50.898388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=36 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:56.333154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293c128-2c79-4e54-815b-e231e38896b9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.335007 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2293c128-2c79-4e54-815b-e231e38896b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:56.405714 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98c240-1745-4b50-91da-56805d523669 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.416411 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293c128-2c79-4e54-815b-e231e38896b9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.416968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98c240-1745-4b50-91da-56805d523669 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.424081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da57f1-d7f6-4e57-b33c-20c0ddfdd574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.424775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da57f1-d7f6-4e57-b33c-20c0ddfdd574 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.425058 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da57f1-d7f6-4e57-b33c-20c0ddfdd574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.425332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da57f1-d7f6-4e57-b33c-20c0ddfdd574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.426768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e1165-b55d-43f4-be22-908a02e327a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.427084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-97da57f1-d7f6-4e57-b33c-20c0ddfdd574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:56.427563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e1165-b55d-43f4-be22-908a02e327a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.428071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e1165-b55d-43f4-be22-908a02e327a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.429660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e1165-b55d-43f4-be22-908a02e327a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.431546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ce0e1165-b55d-43f4-be22-908a02e327a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:56.437558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da57f1-d7f6-4e57-b33c-20c0ddfdd574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.438972 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da57f1-d7f6-4e57-b33c-20c0ddfdd574 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.448599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1229/2471] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:24:56.511671 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e1165-b55d-43f4-be22-908a02e327a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.513206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e1165-b55d-43f4-be22-908a02e327a7 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.524408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1243/2472] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:56.901049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da57f1-d7f6-4e57-b33c-20c0ddfdd574 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.903075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-97da57f1-d7f6-4e57-b33c-20c0ddfdd574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:56.982387 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da57f1-d7f6-4e57-b33c-20c0ddfdd574 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.988871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac546b-8c0b-4163-b024-f14aed5e67c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.989569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac546b-8c0b-4163-b024-f14aed5e67c6 service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.989968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac546b-8c0b-4163-b024-f14aed5e67c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.990252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac546b-8c0b-4163-b024-f14aed5e67c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.992088 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e7ac546b-8c0b-4163-b024-f14aed5e67c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:57.004773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac546b-8c0b-4163-b024-f14aed5e67c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:57.006475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac546b-8c0b-4163-b024-f14aed5e67c6 service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:57.017844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1230/2473] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:24:59.379308 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba3d04-02cd-44c2-9570-ab4d16437060 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:59.380837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba3d04-02cd-44c2-9570-ab4d16437060 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:59.380837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba3d04-02cd-44c2-9570-ab4d16437060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:59.404413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e6ba3d04-02cd-44c2-9570-ab4d16437060 None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:59.405756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e6ba3d04-02cd-44c2-9570-ab4d16437060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:59.508088 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1244/2474] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jul 14 09:24:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:24:59.527044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac546b-8c0b-4163-b024-f14aed5e67c6 service placement] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:59.529236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e7ac546b-8c0b-4163-b024-f14aed5e67c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:59.644779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac546b-8c0b-4163-b024-f14aed5e67c6 service placement] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:59.651325 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bbd6-642c-4ecd-9928-229d4cd88844 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:59.652024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bbd6-642c-4ecd-9928-229d4cd88844 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:59.652309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bbd6-642c-4ecd-9928-229d4cd88844 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:59.652613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bbd6-642c-4ecd-9928-229d4cd88844 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:59.663758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111bbd6-642c-4ecd-9928-229d4cd88844 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:59.665721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111bbd6-642c-4ecd-9928-229d4cd88844 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:59.680504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1231/2475] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:24:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:25:00.331307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba3d04-02cd-44c2-9570-ab4d16437060 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.348780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba3d04-02cd-44c2-9570-ab4d16437060 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:00.357545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f22af-8e99-4f5a-8284-be8416bdb0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:00.359230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f22af-8e99-4f5a-8284-be8416bdb0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.360293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f22af-8e99-4f5a-8284-be8416bdb0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.361038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f22af-8e99-4f5a-8284-be8416bdb0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.364494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4b9f22af-8e99-4f5a-8284-be8416bdb0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:00.391718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f22af-8e99-4f5a-8284-be8416bdb0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:00.395624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f22af-8e99-4f5a-8284-be8416bdb0e3 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:00.457096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1245/2476] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:01.666903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bbd6-642c-4ecd-9928-229d4cd88844 service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:01.685095 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bbd6-642c-4ecd-9928-229d4cd88844 service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:01.694174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096171ec-5e17-4c24-9357-468134992d01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:01.695246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096171ec-5e17-4c24-9357-468134992d01 service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.695763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096171ec-5e17-4c24-9357-468134992d01 service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.696527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096171ec-5e17-4c24-9357-468134992d01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.700403 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-096171ec-5e17-4c24-9357-468134992d01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:01.725758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096171ec-5e17-4c24-9357-468134992d01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:01.729932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096171ec-5e17-4c24-9357-468134992d01 service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:01.763152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1232/2477] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:01.801883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f22af-8e99-4f5a-8284-be8416bdb0e3 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:01.803512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4b9f22af-8e99-4f5a-8284-be8416bdb0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:01.826512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f22af-8e99-4f5a-8284-be8416bdb0e3 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:01.844337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:01.845622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.846106 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.846792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] PATH_INFO: `/v3/users/0bea4c8d195145a29eefee98e4b9ef4c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.848533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bea4c8d195145a29eefee98e4b9ef4c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:01.850874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:01.940932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:01.954708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bea4c8d195145a29eefee98e4b9ef4c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:01.969637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bea4c8d195145a29eefee98e4b9ef4c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:01.971279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bea4c8d195145a29eefee98e4b9ef4c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:01.983337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bea4c8d195145a29eefee98e4b9ef4c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:01.984336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7a2278d0-78dc-48d9-8a3e-bd1af83c8591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bea4c8d195145a29eefee98e4b9ef4c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:02.026131 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1246/2478] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:01 2022] DELETE /identity/v3/users/0bea4c8d195145a29eefee98e4b9ef4c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:02.363940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096171ec-5e17-4c24-9357-468134992d01 service placement] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:02.387656 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096171ec-5e17-4c24-9357-468134992d01 service placement] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:02.558792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:02.576748 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:02.578016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.578384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.578797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] PATH_INFO: `/v3/projects/8bf21f429b6148bcb4ab6f273b31b24a` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:02.581818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf21f429b6148bcb4ab6f273b31b24a)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:02.589063 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:02.707014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf21f429b6148bcb4ab6f273b31b24a', 'request_id': 'req-724a00ad-2058-4dda-921e-6ec0b43435c8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:02.734993 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf21f429b6148bcb4ab6f273b31b24a', 'request_id': 'req-724a00ad-2058-4dda-921e-6ec0b43435c8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:02.751181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf21f429b6148bcb4ab6f273b31b24a', 'request_id': 'req-724a00ad-2058-4dda-921e-6ec0b43435c8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:02.784258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] The token cache is being invalidate because project 8bf21f429b6148bcb4ab6f273b31b24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:02.784615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:02.785447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724a00ad-2058-4dda-921e-6ec0b43435c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:02.790652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1233/2479] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:02 2022] DELETE /identity/v3/projects/8bf21f429b6148bcb4ab6f273b31b24a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:02.792339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01914860-6bf6-456b-a02c-83ccfe5ae085 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.792622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01914860-6bf6-456b-a02c-83ccfe5ae085 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.792990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01914860-6bf6-456b-a02c-83ccfe5ae085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:02.829207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-01914860-6bf6-456b-a02c-83ccfe5ae085 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:02.837465 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-01914860-6bf6-456b-a02c-83ccfe5ae085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:03.021823 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1247/2480] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:03.036073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db142417-5d6f-45e2-b7fc-a31e24e8853c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.036073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db142417-5d6f-45e2-b7fc-a31e24e8853c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.036073 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db142417-5d6f-45e2-b7fc-a31e24e8853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.086584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-db142417-5d6f-45e2-b7fc-a31e24e8853c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:03.088077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-db142417-5d6f-45e2-b7fc-a31e24e8853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:03.111601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1234/2481] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:03.113473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01914860-6bf6-456b-a02c-83ccfe5ae085 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.139101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01914860-6bf6-456b-a02c-83ccfe5ae085 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.145591 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee446aa-c6c1-49cc-98df-772a4d3b1f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.146816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee446aa-c6c1-49cc-98df-772a4d3b1f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.147373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee446aa-c6c1-49cc-98df-772a4d3b1f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.147844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee446aa-c6c1-49cc-98df-772a4d3b1f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.149152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee446aa-c6c1-49cc-98df-772a4d3b1f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:03.153544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee446aa-c6c1-49cc-98df-772a4d3b1f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.155542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee446aa-c6c1-49cc-98df-772a4d3b1f07 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.188754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1248/2482] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:03.192154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db142417-5d6f-45e2-b7fc-a31e24e8853c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.208036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db142417-5d6f-45e2-b7fc-a31e24e8853c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.217108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d831b4-48df-405c-93e4-58572e3a0f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.217967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d831b4-48df-405c-93e4-58572e3a0f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.218167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d831b4-48df-405c-93e4-58572e3a0f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.218516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d831b4-48df-405c-93e4-58572e3a0f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.219212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d831b4-48df-405c-93e4-58572e3a0f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.221601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d831b4-48df-405c-93e4-58572e3a0f6c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.270623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1235/2483] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:03 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:03.275291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee446aa-c6c1-49cc-98df-772a4d3b1f07 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.289809 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee446aa-c6c1-49cc-98df-772a4d3b1f07 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.367675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395c7b6-fff2-4121-896d-ca524ef7e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.367675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395c7b6-fff2-4121-896d-ca524ef7e111 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.367675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395c7b6-fff2-4121-896d-ca524ef7e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.367675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395c7b6-fff2-4121-896d-ca524ef7e111 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.368535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395c7b6-fff2-4121-896d-ca524ef7e111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.370687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395c7b6-fff2-4121-896d-ca524ef7e111 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.400631 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1249/2484] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:03 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:03.404411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d831b4-48df-405c-93e4-58572e3a0f6c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.420607 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d831b4-48df-405c-93e4-58572e3a0f6c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.435216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524277d-b3a6-4354-8dca-5fba6ea08f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.436424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524277d-b3a6-4354-8dca-5fba6ea08f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.436742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524277d-b3a6-4354-8dca-5fba6ea08f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.437324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524277d-b3a6-4354-8dca-5fba6ea08f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.437832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524277d-b3a6-4354-8dca-5fba6ea08f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.441564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524277d-b3a6-4354-8dca-5fba6ea08f66 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.495737 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1236/2485] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:03.498464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395c7b6-fff2-4121-896d-ca524ef7e111 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.518820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395c7b6-fff2-4121-896d-ca524ef7e111 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.532966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e67bd0-ddad-4432-b99c-c10bc20a887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.533881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67bd0-ddad-4432-b99c-c10bc20a887d admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.534180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67bd0-ddad-4432-b99c-c10bc20a887d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.534464 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67bd0-ddad-4432-b99c-c10bc20a887d admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.535234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e67bd0-ddad-4432-b99c-c10bc20a887d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.540185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e67bd0-ddad-4432-b99c-c10bc20a887d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.565488 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1250/2486] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:03.566951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524277d-b3a6-4354-8dca-5fba6ea08f66 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.594115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524277d-b3a6-4354-8dca-5fba6ea08f66 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.616549 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c5cee-0f83-42d9-b91a-b909d163670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.618527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c5cee-0f83-42d9-b91a-b909d163670b admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.622938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c5cee-0f83-42d9-b91a-b909d163670b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.623331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c5cee-0f83-42d9-b91a-b909d163670b admin admin] PATH_INFO: `/v3/projects/d59649a33dbb41e9ab4ebd31ec6e39d9/users/004b067074144b03bf48fdae47c95d23/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.683530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c5cee-0f83-42d9-b91a-b909d163670b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59649a33dbb41e9ab4ebd31ec6e39d9, user_id=004b067074144b03bf48fdae47c95d23, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.689437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c5cee-0f83-42d9-b91a-b909d163670b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.736419 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1237/2487] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:03 2022] PUT /identity/v3/projects/d59649a33dbb41e9ab4ebd31ec6e39d9/users/004b067074144b03bf48fdae47c95d23/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:03.747360 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb8bb-f480-490e-b2a6-ad9985a08366 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.747687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb8bb-f480-490e-b2a6-ad9985a08366 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.747929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb8bb-f480-490e-b2a6-ad9985a08366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.823993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-02abb8bb-f480-490e-b2a6-ad9985a08366 None None] MFA Rules not processed for user `004b067074144b03bf48fdae47c95d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:03.828331 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-02abb8bb-f480-490e-b2a6-ad9985a08366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:03.847932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:03.991180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1251/2488] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:04.004313 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c5cee-0f83-42d9-b91a-b909d163670b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.006721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-904c5cee-0f83-42d9-b91a-b909d163670b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:04.156405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c5cee-0f83-42d9-b91a-b909d163670b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:04.163288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b755841-7ca1-4faf-8051-f177e7ae67c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.164420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755841-7ca1-4faf-8051-f177e7ae67c3 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.164900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755841-7ca1-4faf-8051-f177e7ae67c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.165331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755841-7ca1-4faf-8051-f177e7ae67c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.197485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b755841-7ca1-4faf-8051-f177e7ae67c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:04.200117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b755841-7ca1-4faf-8051-f177e7ae67c3 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:04.230412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1238/2489] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:06.335884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abb8bb-f480-490e-b2a6-ad9985a08366 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:06.337364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-02abb8bb-f480-490e-b2a6-ad9985a08366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:06.450567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abb8bb-f480-490e-b2a6-ad9985a08366 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:06.455822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:06.457294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.457797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.458274 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] PATH_INFO: `/v3/users/f354a75ed51144769da1db0ec92e7980` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.462010 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f354a75ed51144769da1db0ec92e7980)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.464448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.525839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f354a75ed51144769da1db0ec92e7980'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:06.534105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f354a75ed51144769da1db0ec92e7980'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:06.534780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f354a75ed51144769da1db0ec92e7980'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:06.546883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f354a75ed51144769da1db0ec92e7980'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:06.547786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3df2623c-e3b2-47bd-a98a-e2796fdbdeef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f354a75ed51144769da1db0ec92e7980'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:06.569248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1252/2490] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:06 2022] DELETE /identity/v3/users/f354a75ed51144769da1db0ec92e7980 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:06.753126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b755841-7ca1-4faf-8051-f177e7ae67c3 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:06.761968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:06.765155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b755841-7ca1-4faf-8051-f177e7ae67c3 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:06.849755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:06.851283 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.851803 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.852313 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] PATH_INFO: `/v3/projects/f60cd246d561476bbdd6eb5372df7f4f` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.853864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60cd246d561476bbdd6eb5372df7f4f)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.856254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.916987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60cd246d561476bbdd6eb5372df7f4f', 'request_id': 'req-20f9c1c7-0cad-4ea2-b2b6-696462596faa'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:06.933273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60cd246d561476bbdd6eb5372df7f4f', 'request_id': 'req-20f9c1c7-0cad-4ea2-b2b6-696462596faa'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:06.942793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60cd246d561476bbdd6eb5372df7f4f', 'request_id': 'req-20f9c1c7-0cad-4ea2-b2b6-696462596faa'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:06.959566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] The token cache is being invalidate because project f60cd246d561476bbdd6eb5372df7f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:06.959865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:06.960577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-20f9c1c7-0cad-4ea2-b2b6-696462596faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:06.964968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1239/2491] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:06 2022] DELETE /identity/v3/projects/f60cd246d561476bbdd6eb5372df7f4f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:06.970643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886093a2-f2ed-420d-82cb-86b365f4b80a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.971031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886093a2-f2ed-420d-82cb-86b365f4b80a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.972147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886093a2-f2ed-420d-82cb-86b365f4b80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.008773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-886093a2-f2ed-420d-82cb-86b365f4b80a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:07.010266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-886093a2-f2ed-420d-82cb-86b365f4b80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:07.054403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:07.103987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1253/2492] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:07.113895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137271-63ed-4035-b720-5359837eadf8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.114183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137271-63ed-4035-b720-5359837eadf8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.114848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137271-63ed-4035-b720-5359837eadf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.136368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-db137271-63ed-4035-b720-5359837eadf8 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:07.137636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-db137271-63ed-4035-b720-5359837eadf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:07.146359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1240/2493] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:07.152138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886093a2-f2ed-420d-82cb-86b365f4b80a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.162906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886093a2-f2ed-420d-82cb-86b365f4b80a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.167816 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618f9e-d77d-47a7-8ad5-a20271a55501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.168596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618f9e-d77d-47a7-8ad5-a20271a55501 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.168966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618f9e-d77d-47a7-8ad5-a20271a55501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.169322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618f9e-d77d-47a7-8ad5-a20271a55501 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.170145 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87618f9e-d77d-47a7-8ad5-a20271a55501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:07.170559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87618f9e-d77d-47a7-8ad5-a20271a55501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.172402 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87618f9e-d77d-47a7-8ad5-a20271a55501 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.185661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1254/2494] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:07.189774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db137271-63ed-4035-b720-5359837eadf8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.200257 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db137271-63ed-4035-b720-5359837eadf8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.216341 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed35cf4-8526-46a8-b328-74184aaadb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.217143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35cf4-8526-46a8-b328-74184aaadb53 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.217480 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35cf4-8526-46a8-b328-74184aaadb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.218177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35cf4-8526-46a8-b328-74184aaadb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.219363 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed35cf4-8526-46a8-b328-74184aaadb53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.221643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed35cf4-8526-46a8-b328-74184aaadb53 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.259585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1241/2495] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:07 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:07.265040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618f9e-d77d-47a7-8ad5-a20271a55501 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.278212 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618f9e-d77d-47a7-8ad5-a20271a55501 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.350725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a095f-f4bc-4cd9-8a71-a54c6b89dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.351618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a095f-f4bc-4cd9-8a71-a54c6b89dfca admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.351985 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a095f-f4bc-4cd9-8a71-a54c6b89dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.352380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a095f-f4bc-4cd9-8a71-a54c6b89dfca admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.353428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a095f-f4bc-4cd9-8a71-a54c6b89dfca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.355617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a095f-f4bc-4cd9-8a71-a54c6b89dfca admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.391896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1255/2496] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:07 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:07.393232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed35cf4-8526-46a8-b328-74184aaadb53 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.404164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed35cf4-8526-46a8-b328-74184aaadb53 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.408974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d2e2c-a4c4-421e-a1b6-1947c1ad9543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.409785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d2e2c-a4c4-421e-a1b6-1947c1ad9543 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.410078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d2e2c-a4c4-421e-a1b6-1947c1ad9543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.410356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d2e2c-a4c4-421e-a1b6-1947c1ad9543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.411100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d2e2c-a4c4-421e-a1b6-1947c1ad9543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.413044 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d2e2c-a4c4-421e-a1b6-1947c1ad9543 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.429533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1242/2497] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:07.433884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a095f-f4bc-4cd9-8a71-a54c6b89dfca admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.446532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a095f-f4bc-4cd9-8a71-a54c6b89dfca admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.451844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f43a8-dab1-4122-a806-f12030e7bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.452769 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f43a8-dab1-4122-a806-f12030e7bdac admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.453081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f43a8-dab1-4122-a806-f12030e7bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.453430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f43a8-dab1-4122-a806-f12030e7bdac admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.454549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f43a8-dab1-4122-a806-f12030e7bdac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.456239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f43a8-dab1-4122-a806-f12030e7bdac admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.468472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d2e2c-a4c4-421e-a1b6-1947c1ad9543 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.469583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-759d2e2c-a4c4-421e-a1b6-1947c1ad9543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:07.478632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1256/2498] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:07.483695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d2e2c-a4c4-421e-a1b6-1947c1ad9543 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.484869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f43a8-dab1-4122-a806-f12030e7bdac admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.488569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.489627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.490695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.491047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] PATH_INFO: `/v3/users/004b067074144b03bf48fdae47c95d23` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.492388 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] RBAC: Authorizing `identity:delete_user(user_id=004b067074144b03bf48fdae47c95d23)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.495833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.496825 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f43a8-dab1-4122-a806-f12030e7bdac admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.501836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219f365-7944-4868-b908-4a192e992167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.502726 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219f365-7944-4868-b908-4a192e992167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.503080 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219f365-7944-4868-b908-4a192e992167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.503649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219f365-7944-4868-b908-4a192e992167 admin admin] PATH_INFO: `/v3/projects/cf636e7255c94cab9a6188d9220c93c1/users/3c6c09f59ceb41b3b26580a5a71007c2/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.531139 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219f365-7944-4868-b908-4a192e992167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf636e7255c94cab9a6188d9220c93c1, user_id=3c6c09f59ceb41b3b26580a5a71007c2, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.534518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219f365-7944-4868-b908-4a192e992167 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.557695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1257/2499] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:07 2022] PUT /identity/v3/projects/cf636e7255c94cab9a6188d9220c93c1/users/3c6c09f59ceb41b3b26580a5a71007c2/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:07.570483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec3b7f-3be9-45cf-8123-7cca1adb145c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.570876 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec3b7f-3be9-45cf-8123-7cca1adb145c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.571300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec3b7f-3be9-45cf-8123-7cca1adb145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.583533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004b067074144b03bf48fdae47c95d23'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:07.584288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004b067074144b03bf48fdae47c95d23'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:07.587605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:07.595923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004b067074144b03bf48fdae47c95d23'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:07.608922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a3ec3b7f-3be9-45cf-8123-7cca1adb145c None None] MFA Rules not processed for user `3c6c09f59ceb41b3b26580a5a71007c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:07.610302 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a3ec3b7f-3be9-45cf-8123-7cca1adb145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:07.615125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004b067074144b03bf48fdae47c95d23'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:07.616049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-006f3cd8-7706-41b5-b857-98a48150253b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004b067074144b03bf48fdae47c95d23'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:07.635541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1243/2500] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:07 2022] DELETE /identity/v3/users/004b067074144b03bf48fdae47c95d23 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:07.640103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a305-4f68-44ec-8f65-d7243fa673ba None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.640953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a305-4f68-44ec-8f65-d7243fa673ba None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.641238 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a305-4f68-44ec-8f65-d7243fa673ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.659899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-77f1a305-4f68-44ec-8f65-d7243fa673ba None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:07.661652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-77f1a305-4f68-44ec-8f65-d7243fa673ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:07.689806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:07.705069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1258/2501] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:07.710854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec3b7f-3be9-45cf-8123-7cca1adb145c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.713069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a3ec3b7f-3be9-45cf-8123-7cca1adb145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:07.741721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1244/2502] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:07.752493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1a305-4f68-44ec-8f65-d7243fa673ba None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.756305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-77f1a305-4f68-44ec-8f65-d7243fa673ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:07.800162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec3b7f-3be9-45cf-8123-7cca1adb145c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.855694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1a305-4f68-44ec-8f65-d7243fa673ba None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.860191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15da8c0-6521-4b19-81e0-bf0806f473f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.860916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15da8c0-6521-4b19-81e0-bf0806f473f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.861199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15da8c0-6521-4b19-81e0-bf0806f473f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.861483 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15da8c0-6521-4b19-81e0-bf0806f473f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.864280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6de544-a2ee-4d85-bde4-65e7ef7f1b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.865184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6de544-a2ee-4d85-bde4-65e7ef7f1b56 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.865539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6de544-a2ee-4d85-bde4-65e7ef7f1b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.865887 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6de544-a2ee-4d85-bde4-65e7ef7f1b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.886017 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15da8c0-6521-4b19-81e0-bf0806f473f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.887671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15da8c0-6521-4b19-81e0-bf0806f473f6 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.913891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1245/2503] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:25:07.945622 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6de544-a2ee-4d85-bde4-65e7ef7f1b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.947103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6de544-a2ee-4d85-bde4-65e7ef7f1b56 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.961974 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1259/2504] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:25:08.381486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15da8c0-6521-4b19-81e0-bf0806f473f6 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:08.382477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c15da8c0-6521-4b19-81e0-bf0806f473f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:08.396103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15da8c0-6521-4b19-81e0-bf0806f473f6 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:08.402348 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:08.403349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.403634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.403912 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] PATH_INFO: `/v3/projects/d59649a33dbb41e9ab4ebd31ec6e39d9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.405227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59649a33dbb41e9ab4ebd31ec6e39d9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:08.407275 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:08.455486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59649a33dbb41e9ab4ebd31ec6e39d9', 'request_id': 'req-394961b2-d9af-441c-84b2-d3341aa35a44'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:08.464307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59649a33dbb41e9ab4ebd31ec6e39d9', 'request_id': 'req-394961b2-d9af-441c-84b2-d3341aa35a44'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:08.474865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59649a33dbb41e9ab4ebd31ec6e39d9', 'request_id': 'req-394961b2-d9af-441c-84b2-d3341aa35a44'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:08.479945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:08.489862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] The token cache is being invalidate because project d59649a33dbb41e9ab4ebd31ec6e39d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:08.490178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:08.490913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-394961b2-d9af-441c-84b2-d3341aa35a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:08.492870 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1246/2505] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:08 2022] DELETE /identity/v3/projects/d59649a33dbb41e9ab4ebd31ec6e39d9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:08.497929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c66b9b-e122-40c8-b8c6-f3ecc42db361 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.498408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c66b9b-e122-40c8-b8c6-f3ecc42db361 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.498511 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c66b9b-e122-40c8-b8c6-f3ecc42db361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.517385 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f4c66b9b-e122-40c8-b8c6-f3ecc42db361 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:08.518603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f4c66b9b-e122-40c8-b8c6-f3ecc42db361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:08.580535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1260/2506] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:08.589762 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73c8db-58dc-436b-a727-0c5055a5a5e0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.590103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73c8db-58dc-436b-a727-0c5055a5a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.590459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73c8db-58dc-436b-a727-0c5055a5a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.613429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ac73c8db-58dc-436b-a727-0c5055a5a5e0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:08.614638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ac73c8db-58dc-436b-a727-0c5055a5a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:08.624105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1247/2507] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:08.630507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c66b9b-e122-40c8-b8c6-f3ecc42db361 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:08.641340 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c66b9b-e122-40c8-b8c6-f3ecc42db361 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:08.647503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de8c8-238f-4713-bb88-b07ee97858ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:08.648161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de8c8-238f-4713-bb88-b07ee97858ba admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.648441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de8c8-238f-4713-bb88-b07ee97858ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.648739 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de8c8-238f-4713-bb88-b07ee97858ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.649467 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de8c8-238f-4713-bb88-b07ee97858ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:08.649767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de8c8-238f-4713-bb88-b07ee97858ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:08.651385 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de8c8-238f-4713-bb88-b07ee97858ba admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:08.658560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:08.666372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1261/2508] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:08.669954 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73c8db-58dc-436b-a727-0c5055a5a5e0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:08.680320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73c8db-58dc-436b-a727-0c5055a5a5e0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:08.684935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0d5d9-d294-4954-873a-149dc7a41948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:08.685591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d5d9-d294-4954-873a-149dc7a41948 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.685877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d5d9-d294-4954-873a-149dc7a41948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.686146 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d5d9-d294-4954-873a-149dc7a41948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.686852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0d5d9-d294-4954-873a-149dc7a41948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:08.688808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0d5d9-d294-4954-873a-149dc7a41948 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:08.716331 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1248/2509] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:08 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:08.720564 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de8c8-238f-4713-bb88-b07ee97858ba admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:08.732038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de8c8-238f-4713-bb88-b07ee97858ba admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:08.799701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bae6d-5269-4ef1-a711-cc8d623bd7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:08.800384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bae6d-5269-4ef1-a711-cc8d623bd7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.800686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bae6d-5269-4ef1-a711-cc8d623bd7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.800954 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bae6d-5269-4ef1-a711-cc8d623bd7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.801681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bae6d-5269-4ef1-a711-cc8d623bd7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:08.804001 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bae6d-5269-4ef1-a711-cc8d623bd7c3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:08.826439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1262/2510] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:08 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:08.830773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0d5d9-d294-4954-873a-149dc7a41948 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:08.841615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0d5d9-d294-4954-873a-149dc7a41948 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:08.847215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cb414-9497-4a9c-a29a-cce4a8989468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:08.847877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb414-9497-4a9c-a29a-cce4a8989468 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.848279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb414-9497-4a9c-a29a-cce4a8989468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.848555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb414-9497-4a9c-a29a-cce4a8989468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.849369 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cb414-9497-4a9c-a29a-cce4a8989468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:08.850994 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cb414-9497-4a9c-a29a-cce4a8989468 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:08.861776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1249/2511] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:08.865926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bae6d-5269-4ef1-a711-cc8d623bd7c3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:08.876225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bae6d-5269-4ef1-a711-cc8d623bd7c3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:08.881238 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f054b-28c4-41fe-abc2-fc566a33edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:08.881895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f054b-28c4-41fe-abc2-fc566a33edda admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.882179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f054b-28c4-41fe-abc2-fc566a33edda admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.882447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f054b-28c4-41fe-abc2-fc566a33edda admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.883169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f054b-28c4-41fe-abc2-fc566a33edda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:08.884794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f054b-28c4-41fe-abc2-fc566a33edda admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:08.895187 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1263/2512] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:08.899564 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cb414-9497-4a9c-a29a-cce4a8989468 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:08.910116 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cb414-9497-4a9c-a29a-cce4a8989468 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:08.916726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ceb3a-099e-4045-a28c-8633da07ab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:08.917777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ceb3a-099e-4045-a28c-8633da07ab3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.918084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ceb3a-099e-4045-a28c-8633da07ab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.918354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ceb3a-099e-4045-a28c-8633da07ab3f admin admin] PATH_INFO: `/v3/projects/ad3d3cc107ff4824bf8c052ebf921ca2/users/132e0be5c8364bc8a0f951acab41bc05/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.935668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ceb3a-099e-4045-a28c-8633da07ab3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3d3cc107ff4824bf8c052ebf921ca2, user_id=132e0be5c8364bc8a0f951acab41bc05, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:08.938811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ceb3a-099e-4045-a28c-8633da07ab3f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:08.955144 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1250/2513] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:08 2022] PUT /identity/v3/projects/ad3d3cc107ff4824bf8c052ebf921ca2/users/132e0be5c8364bc8a0f951acab41bc05/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:08.967813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b1391-6c07-40e4-9831-eb13bfd8631a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.967991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b1391-6c07-40e4-9831-eb13bfd8631a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.968292 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b1391-6c07-40e4-9831-eb13bfd8631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.997206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-532b1391-6c07-40e4-9831-eb13bfd8631a None None] MFA Rules not processed for user `132e0be5c8364bc8a0f951acab41bc05`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:08.998475 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-532b1391-6c07-40e4-9831-eb13bfd8631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:09.066782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1264/2514] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:09.071416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ceb3a-099e-4045-a28c-8633da07ab3f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.135354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ceb3a-099e-4045-a28c-8633da07ab3f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.140531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef8faa-f62a-4ad2-86e8-ce041f92e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.141255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef8faa-f62a-4ad2-86e8-ce041f92e983 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.141540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef8faa-f62a-4ad2-86e8-ce041f92e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.141828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef8faa-f62a-4ad2-86e8-ce041f92e983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.142503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef8faa-f62a-4ad2-86e8-ce041f92e983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:09.144420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef8faa-f62a-4ad2-86e8-ce041f92e983 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:09.175745 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1251/2515] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:09 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:09.177062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b1391-6c07-40e4-9831-eb13bfd8631a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.188142 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b1391-6c07-40e4-9831-eb13bfd8631a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.245824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399e6d7-6b90-4049-9022-0ac562810cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.246517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e6d7-6b90-4049-9022-0ac562810cce admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.246799 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e6d7-6b90-4049-9022-0ac562810cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.247072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e6d7-6b90-4049-9022-0ac562810cce admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.247793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399e6d7-6b90-4049-9022-0ac562810cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:09.249812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399e6d7-6b90-4049-9022-0ac562810cce admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:09.260239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:09.274428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1265/2516] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:09 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:09.278590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef8faa-f62a-4ad2-86e8-ce041f92e983 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.290477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef8faa-f62a-4ad2-86e8-ce041f92e983 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.295616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78918b2-ca7e-42b9-b611-97fa2aee4bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.296326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78918b2-ca7e-42b9-b611-97fa2aee4bde admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.296613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78918b2-ca7e-42b9-b611-97fa2aee4bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.296928 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78918b2-ca7e-42b9-b611-97fa2aee4bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.297662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78918b2-ca7e-42b9-b611-97fa2aee4bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:09.299269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78918b2-ca7e-42b9-b611-97fa2aee4bde admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:09.315393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1252/2517] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:09.320014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399e6d7-6b90-4049-9022-0ac562810cce admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.330419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399e6d7-6b90-4049-9022-0ac562810cce admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.335963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1c17-91c9-4f50-a479-1dd4489c0146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.336883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1c17-91c9-4f50-a479-1dd4489c0146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.337162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1c17-91c9-4f50-a479-1dd4489c0146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.337430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1c17-91c9-4f50-a479-1dd4489c0146 admin admin] PATH_INFO: `/v3/projects/09950e8cb7cb4e69a1f31b945d87e8ab/users/d6431a0179a34b22b6cddbaf8e680e3c/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.360443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1c17-91c9-4f50-a479-1dd4489c0146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09950e8cb7cb4e69a1f31b945d87e8ab, user_id=d6431a0179a34b22b6cddbaf8e680e3c, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:09.363324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1c17-91c9-4f50-a479-1dd4489c0146 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:09.388135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1266/2518] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:09 2022] PUT /identity/v3/projects/09950e8cb7cb4e69a1f31b945d87e8ab/users/d6431a0179a34b22b6cddbaf8e680e3c/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:09.389861 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78918b2-ca7e-42b9-b611-97fa2aee4bde admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.408334 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78918b2-ca7e-42b9-b611-97fa2aee4bde admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.490677 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b39e4f-6ff5-4d98-9b37-9790422bcce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.491503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b39e4f-6ff5-4d98-9b37-9790422bcce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.491942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b39e4f-6ff5-4d98-9b37-9790422bcce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.492915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b39e4f-6ff5-4d98-9b37-9790422bcce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.493201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b39e4f-6ff5-4d98-9b37-9790422bcce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:09.495036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b39e4f-6ff5-4d98-9b37-9790422bcce6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:09.502788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:09.514771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1253/2519] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:09.519368 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1c17-91c9-4f50-a479-1dd4489c0146 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.532748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1c17-91c9-4f50-a479-1dd4489c0146 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.539944 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377c4ab-33b6-4395-a791-a1c8385d7d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.541273 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377c4ab-33b6-4395-a791-a1c8385d7d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.541789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377c4ab-33b6-4395-a791-a1c8385d7d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.542136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377c4ab-33b6-4395-a791-a1c8385d7d97 admin admin] PATH_INFO: `/v3/projects/09950e8cb7cb4e69a1f31b945d87e8ab/users/d6431a0179a34b22b6cddbaf8e680e3c/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.546068 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377c4ab-33b6-4395-a791-a1c8385d7d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09950e8cb7cb4e69a1f31b945d87e8ab, user_id=d6431a0179a34b22b6cddbaf8e680e3c, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:09.550821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377c4ab-33b6-4395-a791-a1c8385d7d97 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:09.563827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1267/2520] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:09 2022] PUT /identity/v3/projects/09950e8cb7cb4e69a1f31b945d87e8ab/users/d6431a0179a34b22b6cddbaf8e680e3c/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:09.575028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969fdeb-8fde-432d-a122-7722ef0c9821 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.575208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969fdeb-8fde-432d-a122-7722ef0c9821 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.575497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969fdeb-8fde-432d-a122-7722ef0c9821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.616632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a969fdeb-8fde-432d-a122-7722ef0c9821 None None] MFA Rules not processed for user `d6431a0179a34b22b6cddbaf8e680e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:09.617866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a969fdeb-8fde-432d-a122-7722ef0c9821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:09.720707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1254/2521] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:09.734053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377c4ab-33b6-4395-a791-a1c8385d7d97 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.736319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a377c4ab-33b6-4395-a791-a1c8385d7d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:09.813059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377c4ab-33b6-4395-a791-a1c8385d7d97 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.817027 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c9f4-1e36-4c4e-a3a2-c985ee370613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.818407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c9f4-1e36-4c4e-a3a2-c985ee370613 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.818699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c9f4-1e36-4c4e-a3a2-c985ee370613 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.818979 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c9f4-1e36-4c4e-a3a2-c985ee370613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.829748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5c9f4-1e36-4c4e-a3a2-c985ee370613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:09.831232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5c9f4-1e36-4c4e-a3a2-c985ee370613 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:09.843854 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1268/2522] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:09.929759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969fdeb-8fde-432d-a122-7722ef0c9821 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.939575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969fdeb-8fde-432d-a122-7722ef0c9821 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.943581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad82f5-6d96-4d07-bbfd-a489243e78c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.944300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad82f5-6d96-4d07-bbfd-a489243e78c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.944583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad82f5-6d96-4d07-bbfd-a489243e78c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.944884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad82f5-6d96-4d07-bbfd-a489243e78c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:10.005004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad82f5-6d96-4d07-bbfd-a489243e78c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:10.006344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad82f5-6d96-4d07-bbfd-a489243e78c4 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:10.016452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1255/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:14.301302 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c9f4-1e36-4c4e-a3a2-c985ee370613 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:14.303138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-87d5c9f4-1e36-4c4e-a3a2-c985ee370613 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:14.390258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c9f4-1e36-4c4e-a3a2-c985ee370613 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:14.395267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:14.397267 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.397755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.398202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] PATH_INFO: `/v3/users/2e38f3de325f4346916388df3f59c512` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.399674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e38f3de325f4346916388df3f59c512)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:14.402301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:14.475577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e38f3de325f4346916388df3f59c512'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:14.481169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e38f3de325f4346916388df3f59c512'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:14.481932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e38f3de325f4346916388df3f59c512'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:14.490005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e38f3de325f4346916388df3f59c512'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:14.490958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e38f3de325f4346916388df3f59c512'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:14.492154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:14.511771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1269/2524] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:14 2022] DELETE /identity/v3/users/2e38f3de325f4346916388df3f59c512 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:14.516886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d281b7-0d72-4f60-9f52-bb136ca244a1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.517385 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d281b7-0d72-4f60-9f52-bb136ca244a1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.517506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d281b7-0d72-4f60-9f52-bb136ca244a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.535978 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c8d281b7-0d72-4f60-9f52-bb136ca244a1 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:14.537303 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c8d281b7-0d72-4f60-9f52-bb136ca244a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:14.602353 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1256/2525] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:14.614540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:14.616962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:14.685109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f9689-36cf-4697-9599-b369abd7137b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:14.689386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d57e99-e80f-4f95-9b91-b78afd618cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:14.690048 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d57e99-e80f-4f95-9b91-b78afd618cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.690335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d57e99-e80f-4f95-9b91-b78afd618cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.690624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d57e99-e80f-4f95-9b91-b78afd618cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.700984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d57e99-e80f-4f95-9b91-b78afd618cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:14.702423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d57e99-e80f-4f95-9b91-b78afd618cf8 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:14.712768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1270/2526] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:14.994248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d281b7-0d72-4f60-9f52-bb136ca244a1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:14.995889 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c8d281b7-0d72-4f60-9f52-bb136ca244a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:15.009601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d281b7-0d72-4f60-9f52-bb136ca244a1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.014570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.015449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.015723 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.016482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] PATH_INFO: `/v3/projects/b9e5fd23aefc48649bc9a5f60abd79dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.017890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e5fd23aefc48649bc9a5f60abd79dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.019802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.041872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:15.072034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e5fd23aefc48649bc9a5f60abd79dd', 'request_id': 'req-3fc83613-6e23-4eda-9b04-3167b77d6e9d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:15.081663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec49aa-f28a-41d8-8346-b9169a7a332f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.081830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e5fd23aefc48649bc9a5f60abd79dd', 'request_id': 'req-3fc83613-6e23-4eda-9b04-3167b77d6e9d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:15.081957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec49aa-f28a-41d8-8346-b9169a7a332f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.082237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec49aa-f28a-41d8-8346-b9169a7a332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.088718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e5fd23aefc48649bc9a5f60abd79dd', 'request_id': 'req-3fc83613-6e23-4eda-9b04-3167b77d6e9d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:15.100618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f6ec49aa-f28a-41d8-8346-b9169a7a332f None None] MFA Rules not processed for user `6c7099627b964e91870043f512b8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:15.100999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] The token cache is being invalidate because project b9e5fd23aefc48649bc9a5f60abd79dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:15.101292 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:15.101862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f6ec49aa-f28a-41d8-8346-b9169a7a332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:15.102036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3fc83613-6e23-4eda-9b04-3167b77d6e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:15.108270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1257/2527] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:14 2022] DELETE /identity/v3/projects/b9e5fd23aefc48649bc9a5f60abd79dd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:15.110232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090169b4-7823-45be-9c2b-9c9556132f20 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.110382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090169b4-7823-45be-9c2b-9c9556132f20 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.110587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090169b4-7823-45be-9c2b-9c9556132f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.129159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-090169b4-7823-45be-9c2b-9c9556132f20 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:15.130438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-090169b4-7823-45be-9c2b-9c9556132f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:15.165744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1271/2528] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jul 14 09:25:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:15.188821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec49aa-f28a-41d8-8346-b9169a7a332f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.190277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f6ec49aa-f28a-41d8-8346-b9169a7a332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:15.192357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1258/2529] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:15.200151 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb7815-5d48-4c61-99dc-e3ae851ae82a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.200440 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb7815-5d48-4c61-99dc-e3ae851ae82a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.200730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb7815-5d48-4c61-99dc-e3ae851ae82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.221148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6adb7815-5d48-4c61-99dc-e3ae851ae82a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:15.222268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6adb7815-5d48-4c61-99dc-e3ae851ae82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:15.232620 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1259/2530] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:15.237259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb7815-5d48-4c61-99dc-e3ae851ae82a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.247118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb7815-5d48-4c61-99dc-e3ae851ae82a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.252198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf9a6f-f097-4aa2-ac3e-f2758445c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.252882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf9a6f-f097-4aa2-ac3e-f2758445c391 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.253143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf9a6f-f097-4aa2-ac3e-f2758445c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.253420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf9a6f-f097-4aa2-ac3e-f2758445c391 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.254178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf9a6f-f097-4aa2-ac3e-f2758445c391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:15.254486 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf9a6f-f097-4aa2-ac3e-f2758445c391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.256365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf9a6f-f097-4aa2-ac3e-f2758445c391 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.264920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec49aa-f28a-41d8-8346-b9169a7a332f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.269090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1260/2531] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:15.269977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32e4ca-cffd-4b2d-b192-c1ed350fbe35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dab40ef1f8d4f5abf10b92e99e04122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.270639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32e4ca-cffd-4b2d-b192-c1ed350fbe35 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.271018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32e4ca-cffd-4b2d-b192-c1ed350fbe35 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.271266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32e4ca-cffd-4b2d-b192-c1ed350fbe35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.273110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf9a6f-f097-4aa2-ac3e-f2758445c391 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.280884 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32e4ca-cffd-4b2d-b192-c1ed350fbe35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.282836 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32e4ca-cffd-4b2d-b192-c1ed350fbe35 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.284071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf9a6f-f097-4aa2-ac3e-f2758445c391 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.289935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6807c8-3f79-4b2b-87b1-dafca504be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.290584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6807c8-3f79-4b2b-87b1-dafca504be95 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.290872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6807c8-3f79-4b2b-87b1-dafca504be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.291149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6807c8-3f79-4b2b-87b1-dafca504be95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.291840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6807c8-3f79-4b2b-87b1-dafca504be95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.292438 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1272/2532] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jul 14 09:25:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:25:15.293835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6807c8-3f79-4b2b-87b1-dafca504be95 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.322996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1261/2533] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:15 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:15.327159 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32e4ca-cffd-4b2d-b192-c1ed350fbe35 service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.338360 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32e4ca-cffd-4b2d-b192-c1ed350fbe35 service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.352076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:15.403676 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd9b9e-6ce3-420b-9cb5-085780e71226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.404466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd9b9e-6ce3-420b-9cb5-085780e71226 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.404861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd9b9e-6ce3-420b-9cb5-085780e71226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.405138 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd9b9e-6ce3-420b-9cb5-085780e71226 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.405902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd9b9e-6ce3-420b-9cb5-085780e71226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.407940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd9b9e-6ce3-420b-9cb5-085780e71226 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.433164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1273/2534] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:15 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:15.434482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6807c8-3f79-4b2b-87b1-dafca504be95 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.447628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6807c8-3f79-4b2b-87b1-dafca504be95 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.452980 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb622405-739a-4ccf-924f-84c42d0d4d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.453672 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb622405-739a-4ccf-924f-84c42d0d4d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.453996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb622405-739a-4ccf-924f-84c42d0d4d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.454190 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb622405-739a-4ccf-924f-84c42d0d4d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.455057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb622405-739a-4ccf-924f-84c42d0d4d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.456516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb622405-739a-4ccf-924f-84c42d0d4d74 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.467739 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1262/2535] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:15.471853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd9b9e-6ce3-420b-9cb5-085780e71226 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.491785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd9b9e-6ce3-420b-9cb5-085780e71226 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.498223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f408d2-abca-4929-9da0-a73bb686691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.499129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f408d2-abca-4929-9da0-a73bb686691f admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.499417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f408d2-abca-4929-9da0-a73bb686691f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.499708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f408d2-abca-4929-9da0-a73bb686691f admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.500806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f408d2-abca-4929-9da0-a73bb686691f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.518305 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f408d2-abca-4929-9da0-a73bb686691f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.545104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1274/2536] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:15.546309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb622405-739a-4ccf-924f-84c42d0d4d74 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.558881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb622405-739a-4ccf-924f-84c42d0d4d74 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.564390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde6719-4cff-49cb-a5a4-53c041a880fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.565595 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde6719-4cff-49cb-a5a4-53c041a880fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.565879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde6719-4cff-49cb-a5a4-53c041a880fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.576038 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde6719-4cff-49cb-a5a4-53c041a880fa admin admin] PATH_INFO: `/v3/projects/3de3f01905a94da6a8fcd423f42ad7ea/users/3c1bd0133cc545b38211870dfc24a955/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.604392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde6719-4cff-49cb-a5a4-53c041a880fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de3f01905a94da6a8fcd423f42ad7ea, user_id=3c1bd0133cc545b38211870dfc24a955, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.608504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde6719-4cff-49cb-a5a4-53c041a880fa admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.643241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1263/2537] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:15 2022] PUT /identity/v3/projects/3de3f01905a94da6a8fcd423f42ad7ea/users/3c1bd0133cc545b38211870dfc24a955/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:15.646841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8935929-9108-4d54-8884-d5b0f48a4892 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.647424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8935929-9108-4d54-8884-d5b0f48a4892 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.647701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8935929-9108-4d54-8884-d5b0f48a4892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.679708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d8935929-9108-4d54-8884-d5b0f48a4892 None None] MFA Rules not processed for user `3c1bd0133cc545b38211870dfc24a955`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:15.680945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d8935929-9108-4d54-8884-d5b0f48a4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:15.767881 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1275/2538] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:15.779988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde6719-4cff-49cb-a5a4-53c041a880fa admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.783876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7bde6719-4cff-49cb-a5a4-53c041a880fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:15.826930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:15.854022 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde6719-4cff-49cb-a5a4-53c041a880fa admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.858652 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33fb1b-8c75-4e28-80f4-1b2794a8bb14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.859356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33fb1b-8c75-4e28-80f4-1b2794a8bb14 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.860064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33fb1b-8c75-4e28-80f4-1b2794a8bb14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.860064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33fb1b-8c75-4e28-80f4-1b2794a8bb14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.869353 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33fb1b-8c75-4e28-80f4-1b2794a8bb14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.870791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33fb1b-8c75-4e28-80f4-1b2794a8bb14 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.881208 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1264/2539] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:15.907587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8935929-9108-4d54-8884-d5b0f48a4892 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.983262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8935929-9108-4d54-8884-d5b0f48a4892 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.988004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.988920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.989191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.989528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] PATH_INFO: `/v3/users/3c1bd0133cc545b38211870dfc24a955` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.990986 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1bd0133cc545b38211870dfc24a955)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.998777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.030815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:16.050125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1bd0133cc545b38211870dfc24a955'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.059367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1bd0133cc545b38211870dfc24a955'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.060025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1bd0133cc545b38211870dfc24a955'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.066805 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1bd0133cc545b38211870dfc24a955'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.067420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1bd0133cc545b38211870dfc24a955'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.085804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1276/2540] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:15 2022] DELETE /identity/v3/users/3c1bd0133cc545b38211870dfc24a955 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:16.090368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b0477-71ce-4694-8bbb-919bf5575ba5 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.090657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b0477-71ce-4694-8bbb-919bf5575ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.090965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b0477-71ce-4694-8bbb-919bf5575ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.109055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2f0b0477-71ce-4694-8bbb-919bf5575ba5 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:16.110256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2f0b0477-71ce-4694-8bbb-919bf5575ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.177641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1265/2541] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:16.187948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.189420 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.251673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaac9e-1b0e-4886-b151-4dc537619c7b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:16.255726 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bff65-3996-438f-88af-4e672862dbde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:16.256365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bff65-3996-438f-88af-4e672862dbde service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.256653 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bff65-3996-438f-88af-4e672862dbde service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.256963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bff65-3996-438f-88af-4e672862dbde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.266827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bff65-3996-438f-88af-4e672862dbde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:16.268247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bff65-3996-438f-88af-4e672862dbde service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.278011 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1277/2542] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:16.554090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b0477-71ce-4694-8bbb-919bf5575ba5 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.555624 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2f0b0477-71ce-4694-8bbb-919bf5575ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.567606 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b0477-71ce-4694-8bbb-919bf5575ba5 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:16.573072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:16.573340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.573626 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.573917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] PATH_INFO: `/v3/projects/3de3f01905a94da6a8fcd423f42ad7ea` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.575147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de3f01905a94da6a8fcd423f42ad7ea)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:16.577116 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.626613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de3f01905a94da6a8fcd423f42ad7ea', 'request_id': 'req-dc733e82-9ba0-47a6-a628-f40e4b12dac2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.634282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de3f01905a94da6a8fcd423f42ad7ea', 'request_id': 'req-dc733e82-9ba0-47a6-a628-f40e4b12dac2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.641015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de3f01905a94da6a8fcd423f42ad7ea', 'request_id': 'req-dc733e82-9ba0-47a6-a628-f40e4b12dac2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.652236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] The token cache is being invalidate because project 3de3f01905a94da6a8fcd423f42ad7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:16.652576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.653248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.655047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1266/2543] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:16 2022] DELETE /identity/v3/projects/3de3f01905a94da6a8fcd423f42ad7ea => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:16.659966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac0312-79b7-4428-aa3f-3e987591b547 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.660442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac0312-79b7-4428-aa3f-3e987591b547 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.660541 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac0312-79b7-4428-aa3f-3e987591b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.679726 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-75ac0312-79b7-4428-aa3f-3e987591b547 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:16.680952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-75ac0312-79b7-4428-aa3f-3e987591b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.695424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.696963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.749029 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1278/2544] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:16.757110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e055734-c336-43c6-bfee-7042382cb257 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.757398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e055734-c336-43c6-bfee-7042382cb257 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.757679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e055734-c336-43c6-bfee-7042382cb257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.769876 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:16.774811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc733e82-9ba0-47a6-a628-f40e4b12dac2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:16.777207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3e055734-c336-43c6-bfee-7042382cb257 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:16.778423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3e055734-c336-43c6-bfee-7042382cb257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.781680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:16.782774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.783216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.783842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] PATH_INFO: `/v3/users/3c6c09f59ceb41b3b26580a5a71007c2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.786104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6c09f59ceb41b3b26580a5a71007c2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:16.787237 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1279/2545] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:16.788260 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.791696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e055734-c336-43c6-bfee-7042382cb257 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.802286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e055734-c336-43c6-bfee-7042382cb257 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:16.807665 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3e884-2dc9-498a-9796-0ca15d14e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:16.809259 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3e884-2dc9-498a-9796-0ca15d14e200 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.809548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3e884-2dc9-498a-9796-0ca15d14e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.809824 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3e884-2dc9-498a-9796-0ca15d14e200 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.810561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3e884-2dc9-498a-9796-0ca15d14e200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:16.810994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3e884-2dc9-498a-9796-0ca15d14e200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:16.812623 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3e884-2dc9-498a-9796-0ca15d14e200 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.828057 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1280/2546] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:16.832567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3e884-2dc9-498a-9796-0ca15d14e200 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.842636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6c09f59ceb41b3b26580a5a71007c2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.843288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3e884-2dc9-498a-9796-0ca15d14e200 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:16.843421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6c09f59ceb41b3b26580a5a71007c2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.848932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cd443-be8f-4a52-9439-c93e6718a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:16.849783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cd443-be8f-4a52-9439-c93e6718a0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.850064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cd443-be8f-4a52-9439-c93e6718a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.850332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cd443-be8f-4a52-9439-c93e6718a0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.851054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cd443-be8f-4a52-9439-c93e6718a0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:16.851788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6c09f59ceb41b3b26580a5a71007c2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.853003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cd443-be8f-4a52-9439-c93e6718a0a4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.861609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6c09f59ceb41b3b26580a5a71007c2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.862444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6c09f59ceb41b3b26580a5a71007c2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:16.880209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1281/2547] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:16 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:16.880810 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1267/2548] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:16 2022] DELETE /identity/v3/users/3c6c09f59ceb41b3b26580a5a71007c2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:16.884540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.885060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63660f8-d381-4db9-805c-4387be30e06f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.885354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63660f8-d381-4db9-805c-4387be30e06f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.885633 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63660f8-d381-4db9-805c-4387be30e06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.886133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.898408 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:16.905946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d63660f8-d381-4db9-805c-4387be30e06f None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:16.908072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d63660f8-d381-4db9-805c-4387be30e06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.951278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbef6c8-e414-4e91-9a26-c3acbfc82247 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:16.956374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0c303-eb90-4334-a1af-d2e5d0d77ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:16.957206 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0c303-eb90-4334-a1af-d2e5d0d77ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.957539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0c303-eb90-4334-a1af-d2e5d0d77ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.957818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0c303-eb90-4334-a1af-d2e5d0d77ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.958558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0c303-eb90-4334-a1af-d2e5d0d77ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:16.961204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0c303-eb90-4334-a1af-d2e5d0d77ae2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.969930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1282/2549] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:16.980447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63660f8-d381-4db9-805c-4387be30e06f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.981820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d63660f8-d381-4db9-805c-4387be30e06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.985065 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1268/2550] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:16 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:16.988929 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0c303-eb90-4334-a1af-d2e5d0d77ae2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.001087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0c303-eb90-4334-a1af-d2e5d0d77ae2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.006397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c01e52-b1ea-4eae-baae-a098810f5c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.007053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c01e52-b1ea-4eae-baae-a098810f5c28 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.007339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c01e52-b1ea-4eae-baae-a098810f5c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.007617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c01e52-b1ea-4eae-baae-a098810f5c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.008375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c01e52-b1ea-4eae-baae-a098810f5c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.010006 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c01e52-b1ea-4eae-baae-a098810f5c28 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.020118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1269/2551] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:17.024429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c01e52-b1ea-4eae-baae-a098810f5c28 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.035259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c01e52-b1ea-4eae-baae-a098810f5c28 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.043012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73353da2-3964-4da5-8a3b-ee59e97d66fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.043542 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63660f8-d381-4db9-805c-4387be30e06f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.044200 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73353da2-3964-4da5-8a3b-ee59e97d66fc admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.044727 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73353da2-3964-4da5-8a3b-ee59e97d66fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.045210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73353da2-3964-4da5-8a3b-ee59e97d66fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.046332 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73353da2-3964-4da5-8a3b-ee59e97d66fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.047540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea9935-6f99-499b-9be2-6a99ad6fea3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.048190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9935-6f99-499b-9be2-6a99ad6fea3e service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.048527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9935-6f99-499b-9be2-6a99ad6fea3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.048767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9935-6f99-499b-9be2-6a99ad6fea3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.049178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73353da2-3964-4da5-8a3b-ee59e97d66fc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.061528 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1270/2552] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:17.061756 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea9935-6f99-499b-9be2-6a99ad6fea3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.062959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea9935-6f99-499b-9be2-6a99ad6fea3e service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.065541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73353da2-3964-4da5-8a3b-ee59e97d66fc admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.075233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1283/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:25:17.081880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73353da2-3964-4da5-8a3b-ee59e97d66fc admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.088235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8dc93-daf8-4232-90a5-a0dc75bf8659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.089232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8dc93-daf8-4232-90a5-a0dc75bf8659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.090111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8dc93-daf8-4232-90a5-a0dc75bf8659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.090111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8dc93-daf8-4232-90a5-a0dc75bf8659 admin admin] PATH_INFO: `/v3/projects/b29b754dd90b41108159842f18be030f/users/583a594b732a48e39351d2690ea76166/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.106995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8dc93-daf8-4232-90a5-a0dc75bf8659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29b754dd90b41108159842f18be030f, user_id=583a594b732a48e39351d2690ea76166, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.109754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8dc93-daf8-4232-90a5-a0dc75bf8659 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.125729 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1271/2554] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:17 2022] PUT /identity/v3/projects/b29b754dd90b41108159842f18be030f/users/583a594b732a48e39351d2690ea76166/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:17.137257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7874-695d-4f26-b5d1-54122ae8b7a7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.137946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7874-695d-4f26-b5d1-54122ae8b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.138396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7874-695d-4f26-b5d1-54122ae8b7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.172112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-11ce7874-695d-4f26-b5d1-54122ae8b7a7 None None] MFA Rules not processed for user `583a594b732a48e39351d2690ea76166`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:17.173565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-11ce7874-695d-4f26-b5d1-54122ae8b7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:17.270544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1284/2555] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:17.284328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8dc93-daf8-4232-90a5-a0dc75bf8659 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.286779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-28b8dc93-daf8-4232-90a5-a0dc75bf8659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:17.315392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:17.375405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8dc93-daf8-4232-90a5-a0dc75bf8659 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.381199 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe1b49-3dca-4f26-b0d2-ec49b69d0b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.381915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1b49-3dca-4f26-b0d2-ec49b69d0b8a service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.382155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1b49-3dca-4f26-b0d2-ec49b69d0b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.382433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1b49-3dca-4f26-b0d2-ec49b69d0b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.396613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe1b49-3dca-4f26-b0d2-ec49b69d0b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.398674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe1b49-3dca-4f26-b0d2-ec49b69d0b8a service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.409649 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1272/2556] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:17.421569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7874-695d-4f26-b5d1-54122ae8b7a7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.424227 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-11ce7874-695d-4f26-b5d1-54122ae8b7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:17.487258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:17.517248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7874-695d-4f26-b5d1-54122ae8b7a7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.523009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.523829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.524134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.524413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] PATH_INFO: `/v3/projects/cf636e7255c94cab9a6188d9220c93c1` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.525667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf636e7255c94cab9a6188d9220c93c1)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.527717 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.582674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf636e7255c94cab9a6188d9220c93c1', 'request_id': 'req-7c6aa309-c19c-4859-b47e-181fd59f10ae'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:17.591089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf636e7255c94cab9a6188d9220c93c1', 'request_id': 'req-7c6aa309-c19c-4859-b47e-181fd59f10ae'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:17.599312 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf636e7255c94cab9a6188d9220c93c1', 'request_id': 'req-7c6aa309-c19c-4859-b47e-181fd59f10ae'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:17.613232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] The token cache is being invalidate because project cf636e7255c94cab9a6188d9220c93c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:17.613526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:17.614201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7c6aa309-c19c-4859-b47e-181fd59f10ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:17.615906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1285/2557] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:17 2022] DELETE /identity/v3/projects/cf636e7255c94cab9a6188d9220c93c1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:17.620537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d4e2a-58fe-473f-862e-a1ecfb128d72 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.621078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d4e2a-58fe-473f-862e-a1ecfb128d72 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.621177 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d4e2a-58fe-473f-862e-a1ecfb128d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.639526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-048d4e2a-58fe-473f-862e-a1ecfb128d72 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:17.640778 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-048d4e2a-58fe-473f-862e-a1ecfb128d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:17.713127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1273/2558] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:17.723053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84050ac-3ff3-41f8-a58e-0ddcc1e516c3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.723535 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84050ac-3ff3-41f8-a58e-0ddcc1e516c3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.723634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84050ac-3ff3-41f8-a58e-0ddcc1e516c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.746726 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f84050ac-3ff3-41f8-a58e-0ddcc1e516c3 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:17.748010 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f84050ac-3ff3-41f8-a58e-0ddcc1e516c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:17.758251 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1286/2559] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:17.762618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d4e2a-58fe-473f-862e-a1ecfb128d72 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.777485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d4e2a-58fe-473f-862e-a1ecfb128d72 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.782253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04142347-199a-4e28-906d-088cde27d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.782930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142347-199a-4e28-906d-088cde27d4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.783218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142347-199a-4e28-906d-088cde27d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.783502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142347-199a-4e28-906d-088cde27d4a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.784284 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04142347-199a-4e28-906d-088cde27d4a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:17.784591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04142347-199a-4e28-906d-088cde27d4a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.786389 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04142347-199a-4e28-906d-088cde27d4a0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.801020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1274/2560] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:17.806337 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84050ac-3ff3-41f8-a58e-0ddcc1e516c3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.816234 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84050ac-3ff3-41f8-a58e-0ddcc1e516c3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.823356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8513a4-6644-4479-b913-29982633407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.824330 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8513a4-6644-4479-b913-29982633407f admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.824621 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8513a4-6644-4479-b913-29982633407f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.825222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8513a4-6644-4479-b913-29982633407f admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.825697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8513a4-6644-4479-b913-29982633407f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.827617 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8513a4-6644-4479-b913-29982633407f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.857437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1287/2561] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:17 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:17.861546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04142347-199a-4e28-906d-088cde27d4a0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.873520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04142347-199a-4e28-906d-088cde27d4a0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.946375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a7d2a-2c4e-45dc-879e-7ea3b2593c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.947181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a7d2a-2c4e-45dc-879e-7ea3b2593c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.947431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a7d2a-2c4e-45dc-879e-7ea3b2593c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.947706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a7d2a-2c4e-45dc-879e-7ea3b2593c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.948423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a7d2a-2c4e-45dc-879e-7ea3b2593c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.950501 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a7d2a-2c4e-45dc-879e-7ea3b2593c0a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.975546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1275/2562] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:17 2022] POST /identity/v3/users => generated 301 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:17.977789 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8513a4-6644-4479-b913-29982633407f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.988934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8513a4-6644-4479-b913-29982633407f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.994232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5cb34-968e-4858-a36f-401498ba6aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.994913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5cb34-968e-4858-a36f-401498ba6aff admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.995181 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5cb34-968e-4858-a36f-401498ba6aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.995453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5cb34-968e-4858-a36f-401498ba6aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.996184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5cb34-968e-4858-a36f-401498ba6aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.997853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5cb34-968e-4858-a36f-401498ba6aff admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.009685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1288/2563] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:18.015684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a7d2a-2c4e-45dc-879e-7ea3b2593c0a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.026755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a7d2a-2c4e-45dc-879e-7ea3b2593c0a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.031343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ba44c-c4f8-4667-b38a-172df238c240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.032015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba44c-c4f8-4667-b38a-172df238c240 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.032299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba44c-c4f8-4667-b38a-172df238c240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.032577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba44c-c4f8-4667-b38a-172df238c240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.033352 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ba44c-c4f8-4667-b38a-172df238c240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.034983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ba44c-c4f8-4667-b38a-172df238c240 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.045178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1276/2564] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:18.049556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5cb34-968e-4858-a36f-401498ba6aff admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.060163 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5cb34-968e-4858-a36f-401498ba6aff admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.066286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386619-9946-48ab-b9e3-e43eeeac9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.067186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386619-9946-48ab-b9e3-e43eeeac9217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.067473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386619-9946-48ab-b9e3-e43eeeac9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.067813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386619-9946-48ab-b9e3-e43eeeac9217 admin admin] PATH_INFO: `/v3/projects/38d7fb402e354d8b8cebb31c7f6a8bc6/users/30fad93bc65641c68eed0c02c7c274e2/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.083076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75386619-9946-48ab-b9e3-e43eeeac9217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d7fb402e354d8b8cebb31c7f6a8bc6, user_id=30fad93bc65641c68eed0c02c7c274e2, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.086197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75386619-9946-48ab-b9e3-e43eeeac9217 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.101179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1289/2565] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:18 2022] PUT /identity/v3/projects/38d7fb402e354d8b8cebb31c7f6a8bc6/users/30fad93bc65641c68eed0c02c7c274e2/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:18.112851 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2220d-a964-477d-8962-e965ba579742 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.113161 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2220d-a964-477d-8962-e965ba579742 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.113437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2220d-a964-477d-8962-e965ba579742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.140650 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a5d2220d-a964-477d-8962-e965ba579742 None None] MFA Rules not processed for user `30fad93bc65641c68eed0c02c7c274e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:18.141865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a5d2220d-a964-477d-8962-e965ba579742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:18.158681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:18.208418 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1277/2566] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:18.213590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386619-9946-48ab-b9e3-e43eeeac9217 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.283071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386619-9946-48ab-b9e3-e43eeeac9217 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.288761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0142ae1-084f-4781-b2af-95d7e8854d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.289504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0142ae1-084f-4781-b2af-95d7e8854d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.289784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0142ae1-084f-4781-b2af-95d7e8854d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.290055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0142ae1-084f-4781-b2af-95d7e8854d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.290745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0142ae1-084f-4781-b2af-95d7e8854d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.292677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0142ae1-084f-4781-b2af-95d7e8854d2c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.303260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:18.323275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1290/2567] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:18 2022] POST /identity/v3/projects => generated 401 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:18.329112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2220d-a964-477d-8962-e965ba579742 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.340213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2220d-a964-477d-8962-e965ba579742 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.400438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2948d2f-22b1-416e-acab-9d1d8f3833e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.401139 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2948d2f-22b1-416e-acab-9d1d8f3833e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.401417 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2948d2f-22b1-416e-acab-9d1d8f3833e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.401696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2948d2f-22b1-416e-acab-9d1d8f3833e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.402370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2948d2f-22b1-416e-acab-9d1d8f3833e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.404291 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2948d2f-22b1-416e-acab-9d1d8f3833e3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.433859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1278/2568] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:18 2022] POST /identity/v3/users => generated 307 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:18.440189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0142ae1-084f-4781-b2af-95d7e8854d2c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.453090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0142ae1-084f-4781-b2af-95d7e8854d2c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.459028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d1b17-32f8-4022-abc0-b867316406c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.459722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1b17-32f8-4022-abc0-b867316406c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.460006 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1b17-32f8-4022-abc0-b867316406c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.460282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1b17-32f8-4022-abc0-b867316406c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.461078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d1b17-32f8-4022-abc0-b867316406c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.462685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d1b17-32f8-4022-abc0-b867316406c6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.473675 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1291/2569] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:18.478118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2948d2f-22b1-416e-acab-9d1d8f3833e3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.489099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2948d2f-22b1-416e-acab-9d1d8f3833e3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.495018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67555f0a-d41e-4999-ac93-c08420ebc751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.495950 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555f0a-d41e-4999-ac93-c08420ebc751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.496235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555f0a-d41e-4999-ac93-c08420ebc751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.496514 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555f0a-d41e-4999-ac93-c08420ebc751 admin admin] PATH_INFO: `/v3/projects/20de58e051b246d5bde2be2d4deeefe2/users/55cc90dd4bb34687bdefd2f0fbb62002/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.512747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67555f0a-d41e-4999-ac93-c08420ebc751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20de58e051b246d5bde2be2d4deeefe2, user_id=55cc90dd4bb34687bdefd2f0fbb62002, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.515767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67555f0a-d41e-4999-ac93-c08420ebc751 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.529996 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1279/2570] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:18 2022] PUT /identity/v3/projects/20de58e051b246d5bde2be2d4deeefe2/users/55cc90dd4bb34687bdefd2f0fbb62002/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:18.534659 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d1b17-32f8-4022-abc0-b867316406c6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.550661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d1b17-32f8-4022-abc0-b867316406c6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.617716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2ef0c-7a81-42e5-a1c8-57276482a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.618389 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ef0c-7a81-42e5-a1c8-57276482a98e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.618666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ef0c-7a81-42e5-a1c8-57276482a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.618937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ef0c-7a81-42e5-a1c8-57276482a98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.619660 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2ef0c-7a81-42e5-a1c8-57276482a98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.621290 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2ef0c-7a81-42e5-a1c8-57276482a98e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.631969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1292/2571] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:18.636513 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67555f0a-d41e-4999-ac93-c08420ebc751 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.648114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67555f0a-d41e-4999-ac93-c08420ebc751 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.656376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d802d2-a74a-46eb-824c-49f47df19e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.657868 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d802d2-a74a-46eb-824c-49f47df19e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.658261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d802d2-a74a-46eb-824c-49f47df19e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.658604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d802d2-a74a-46eb-824c-49f47df19e75 admin admin] PATH_INFO: `/v3/projects/20de58e051b246d5bde2be2d4deeefe2/users/55cc90dd4bb34687bdefd2f0fbb62002/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.661138 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d802d2-a74a-46eb-824c-49f47df19e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20de58e051b246d5bde2be2d4deeefe2, user_id=55cc90dd4bb34687bdefd2f0fbb62002, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.664152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d802d2-a74a-46eb-824c-49f47df19e75 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.679475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1280/2572] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:18 2022] PUT /identity/v3/projects/20de58e051b246d5bde2be2d4deeefe2/users/55cc90dd4bb34687bdefd2f0fbb62002/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:18.694211 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03c7f7-bf0a-42f6-a787-946009664c1c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.694499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03c7f7-bf0a-42f6-a787-946009664c1c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.694771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03c7f7-bf0a-42f6-a787-946009664c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.724137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9c03c7f7-bf0a-42f6-a787-946009664c1c None None] MFA Rules not processed for user `55cc90dd4bb34687bdefd2f0fbb62002`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:18.725411 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9c03c7f7-bf0a-42f6-a787-946009664c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:18.804137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1293/2573] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:18.815357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d802d2-a74a-46eb-824c-49f47df19e75 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.817487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-21d802d2-a74a-46eb-824c-49f47df19e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:18.883610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d802d2-a74a-46eb-824c-49f47df19e75 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.887897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bd2e8-8878-4519-9c87-403ac67c017f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.888561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bd2e8-8878-4519-9c87-403ac67c017f service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.888880 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bd2e8-8878-4519-9c87-403ac67c017f service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.889488 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bd2e8-8878-4519-9c87-403ac67c017f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.899716 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bd2e8-8878-4519-9c87-403ac67c017f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.901205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bd2e8-8878-4519-9c87-403ac67c017f service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.911176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1281/2574] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:19.140149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03c7f7-bf0a-42f6-a787-946009664c1c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.158796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03c7f7-bf0a-42f6-a787-946009664c1c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.165634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfb0c8-8b7c-4592-a947-9a65ce591bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.166441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfb0c8-8b7c-4592-a947-9a65ce591bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.166826 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfb0c8-8b7c-4592-a947-9a65ce591bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.167224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfb0c8-8b7c-4592-a947-9a65ce591bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.229285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfb0c8-8b7c-4592-a947-9a65ce591bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.230782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfb0c8-8b7c-4592-a947-9a65ce591bc6 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.235597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:19.241485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1294/2575] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:22.629570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bd2e8-8878-4519-9c87-403ac67c017f service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:22.631404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-266bd2e8-8878-4519-9c87-403ac67c017f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:22.651500 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:22.713404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bd2e8-8878-4519-9c87-403ac67c017f service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:22.718207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:22.719089 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:22.719373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:22.719642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] PATH_INFO: `/v3/users/583a594b732a48e39351d2690ea76166` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:22.720848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583a594b732a48e39351d2690ea76166)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:22.722772 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:22.773690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583a594b732a48e39351d2690ea76166'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:22.774426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583a594b732a48e39351d2690ea76166'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:22.782256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583a594b732a48e39351d2690ea76166'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:22.789792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583a594b732a48e39351d2690ea76166'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:22.790452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583a594b732a48e39351d2690ea76166'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:22.809092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1282/2576] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:22 2022] DELETE /identity/v3/users/583a594b732a48e39351d2690ea76166 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:22.813766 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11783056-0529-4d6f-80e5-7a0e6e621644 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:22.814255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11783056-0529-4d6f-80e5-7a0e6e621644 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:22.814255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11783056-0529-4d6f-80e5-7a0e6e621644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:22.831866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-11783056-0529-4d6f-80e5-7a0e6e621644 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:22.833124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-11783056-0529-4d6f-80e5-7a0e6e621644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:22.897530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1295/2577] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:22.908282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:22.910248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:22.974843 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787208-0cd0-434d-9f44-8ef4613aad77 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:22.979493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90addfab-dde5-4ef7-bc40-e1e22bdf56c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:22.980159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90addfab-dde5-4ef7-bc40-e1e22bdf56c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:22.980449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90addfab-dde5-4ef7-bc40-e1e22bdf56c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:22.980754 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90addfab-dde5-4ef7-bc40-e1e22bdf56c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:22.991469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90addfab-dde5-4ef7-bc40-e1e22bdf56c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:22.992974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90addfab-dde5-4ef7-bc40-e1e22bdf56c5 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.003020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1283/2578] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:23.298690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11783056-0529-4d6f-80e5-7a0e6e621644 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.306636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-11783056-0529-4d6f-80e5-7a0e6e621644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:23.331471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11783056-0529-4d6f-80e5-7a0e6e621644 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.339662 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.341390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.341678 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.341959 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] PATH_INFO: `/v3/projects/b29b754dd90b41108159842f18be030f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.343471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29b754dd90b41108159842f18be030f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:23.345829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.394181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90addfab-dde5-4ef7-bc40-e1e22bdf56c5 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.395785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-90addfab-dde5-4ef7-bc40-e1e22bdf56c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:23.401007 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29b754dd90b41108159842f18be030f', 'request_id': 'req-d7557498-eaec-4c88-9cd0-3a1b754cd81e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:23.406883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29b754dd90b41108159842f18be030f', 'request_id': 'req-d7557498-eaec-4c88-9cd0-3a1b754cd81e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:23.410253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90addfab-dde5-4ef7-bc40-e1e22bdf56c5 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.415393 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29b754dd90b41108159842f18be030f', 'request_id': 'req-d7557498-eaec-4c88-9cd0-3a1b754cd81e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:23.426586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] The token cache is being invalidate because project b29b754dd90b41108159842f18be030f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:23.426910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:23.428023 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d7557498-eaec-4c88-9cd0-3a1b754cd81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:23.429568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1296/2579] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:23 2022] DELETE /identity/v3/projects/b29b754dd90b41108159842f18be030f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:23.448087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:23.478187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.479116 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.479401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.479677 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] PATH_INFO: `/v3/users/30fad93bc65641c68eed0c02c7c274e2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.481122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30fad93bc65641c68eed0c02c7c274e2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:23.483182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.539845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30fad93bc65641c68eed0c02c7c274e2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:23.540538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30fad93bc65641c68eed0c02c7c274e2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:23.549940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30fad93bc65641c68eed0c02c7c274e2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:23.558031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30fad93bc65641c68eed0c02c7c274e2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:23.558799 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30fad93bc65641c68eed0c02c7c274e2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:23.578121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1284/2580] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:23 2022] DELETE /identity/v3/users/30fad93bc65641c68eed0c02c7c274e2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:23.582882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26b20b-5c56-4711-a88a-05ece66fac7e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.583207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26b20b-5c56-4711-a88a-05ece66fac7e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.583488 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26b20b-5c56-4711-a88a-05ece66fac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.605021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8b26b20b-5c56-4711-a88a-05ece66fac7e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:23.606352 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8b26b20b-5c56-4711-a88a-05ece66fac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:23.676842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1297/2581] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:23.687118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.688678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:23.749567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0837b3-8c10-4694-ac85-3d4c3c958fe0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.753493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5e33b-8273-4c2f-8432-e7a694a68ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.754145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e33b-8273-4c2f-8432-e7a694a68ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.754427 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e33b-8273-4c2f-8432-e7a694a68ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.754708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e33b-8273-4c2f-8432-e7a694a68ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.771619 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5e33b-8273-4c2f-8432-e7a694a68ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:23.773998 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5e33b-8273-4c2f-8432-e7a694a68ed6 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.788478 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1285/2582] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:24.071994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26b20b-5c56-4711-a88a-05ece66fac7e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.073600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8b26b20b-5c56-4711-a88a-05ece66fac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:24.086281 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26b20b-5c56-4711-a88a-05ece66fac7e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.091434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.092465 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.092751 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.093052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] PATH_INFO: `/v3/projects/38d7fb402e354d8b8cebb31c7f6a8bc6` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.094810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d7fb402e354d8b8cebb31c7f6a8bc6)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.096910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.120112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:24.149221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d7fb402e354d8b8cebb31c7f6a8bc6', 'request_id': 'req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.155499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d7fb402e354d8b8cebb31c7f6a8bc6', 'request_id': 'req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.163507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d7fb402e354d8b8cebb31c7f6a8bc6', 'request_id': 'req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.179103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] The token cache is being invalidate because project 38d7fb402e354d8b8cebb31c7f6a8bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:24.179386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.180054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.181914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1298/2583] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:24 2022] DELETE /identity/v3/projects/38d7fb402e354d8b8cebb31c7f6a8bc6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:24.185837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5e33b-8273-4c2f-8432-e7a694a68ed6 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.196033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5e33b-8273-4c2f-8432-e7a694a68ed6 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.250408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:24.257045 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.258019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.258491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.258776 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] PATH_INFO: `/v3/users/55cc90dd4bb34687bdefd2f0fbb62002` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.260134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55cc90dd4bb34687bdefd2f0fbb62002)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.262170 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.310815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55cc90dd4bb34687bdefd2f0fbb62002'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.311461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55cc90dd4bb34687bdefd2f0fbb62002'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.321054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55cc90dd4bb34687bdefd2f0fbb62002'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.327877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55cc90dd4bb34687bdefd2f0fbb62002'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.328523 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e26fb41e-788f-4586-ae04-76911e2287c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55cc90dd4bb34687bdefd2f0fbb62002'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.346962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1286/2584] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:24 2022] DELETE /identity/v3/users/55cc90dd4bb34687bdefd2f0fbb62002 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:24.638598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.640441 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:24.657051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bf61b-282c-4d70-b9e9-0d2ad77c12a9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.717286 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.718165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.718442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.718713 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] PATH_INFO: `/v3/projects/20de58e051b246d5bde2be2d4deeefe2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.719902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20de58e051b246d5bde2be2d4deeefe2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.721859 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.771480 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20de58e051b246d5bde2be2d4deeefe2', 'request_id': 'req-834218b1-8d87-4883-993a-b66c74f67226'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.777436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20de58e051b246d5bde2be2d4deeefe2', 'request_id': 'req-834218b1-8d87-4883-993a-b66c74f67226'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.785857 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20de58e051b246d5bde2be2d4deeefe2', 'request_id': 'req-834218b1-8d87-4883-993a-b66c74f67226'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.797432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] The token cache is being invalidate because project 20de58e051b246d5bde2be2d4deeefe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:24.797733 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.798423 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-834218b1-8d87-4883-993a-b66c74f67226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:24.800058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1299/2585] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:24 2022] DELETE /identity/v3/projects/20de58e051b246d5bde2be2d4deeefe2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:24.805773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa43b04-fee0-427c-8899-5c8f252c9bd9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.806270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa43b04-fee0-427c-8899-5c8f252c9bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.806372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa43b04-fee0-427c-8899-5c8f252c9bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.824874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3aa43b04-fee0-427c-8899-5c8f252c9bd9 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:24.826078 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3aa43b04-fee0-427c-8899-5c8f252c9bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:24.888037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1287/2586] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:24.896946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc3f7e-937c-4b63-8d9d-5190b6beb301 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.897241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc3f7e-937c-4b63-8d9d-5190b6beb301 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.897516 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc3f7e-937c-4b63-8d9d-5190b6beb301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.917436 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-acfc3f7e-937c-4b63-8d9d-5190b6beb301 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:24.918641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-acfc3f7e-937c-4b63-8d9d-5190b6beb301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:24.928285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1300/2587] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:24.932627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa43b04-fee0-427c-8899-5c8f252c9bd9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.943416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa43b04-fee0-427c-8899-5c8f252c9bd9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.948943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14179a-05e9-4b53-9a36-15afe86f7c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.949612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14179a-05e9-4b53-9a36-15afe86f7c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.949892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14179a-05e9-4b53-9a36-15afe86f7c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.950164 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14179a-05e9-4b53-9a36-15afe86f7c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.950898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14179a-05e9-4b53-9a36-15afe86f7c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:24.951206 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14179a-05e9-4b53-9a36-15afe86f7c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.952827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14179a-05e9-4b53-9a36-15afe86f7c8e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.965328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1288/2588] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:24.969821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc3f7e-937c-4b63-8d9d-5190b6beb301 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.979837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc3f7e-937c-4b63-8d9d-5190b6beb301 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.985219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd9049-f49a-4cf0-b66a-573a5eba7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.985874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9049-f49a-4cf0-b66a-573a5eba7cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.986154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9049-f49a-4cf0-b66a-573a5eba7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.986426 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9049-f49a-4cf0-b66a-573a5eba7cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.987184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd9049-f49a-4cf0-b66a-573a5eba7cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.989155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd9049-f49a-4cf0-b66a-573a5eba7cf1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.018787 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1301/2589] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:24 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:25.020760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14179a-05e9-4b53-9a36-15afe86f7c8e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.031632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14179a-05e9-4b53-9a36-15afe86f7c8e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.091576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6072db-27e3-4309-9870-b78761c57476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.092259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6072db-27e3-4309-9870-b78761c57476 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.092540 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6072db-27e3-4309-9870-b78761c57476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.092846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6072db-27e3-4309-9870-b78761c57476 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.093541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6072db-27e3-4309-9870-b78761c57476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.095480 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6072db-27e3-4309-9870-b78761c57476 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.104471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:25.122042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1289/2590] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:25 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:25.128206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd9049-f49a-4cf0-b66a-573a5eba7cf1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.139760 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd9049-f49a-4cf0-b66a-573a5eba7cf1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.144650 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f13a7-eb05-4cdf-b429-074854963354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.145350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f13a7-eb05-4cdf-b429-074854963354 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.145632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f13a7-eb05-4cdf-b429-074854963354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.145908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f13a7-eb05-4cdf-b429-074854963354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.146662 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f13a7-eb05-4cdf-b429-074854963354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.148419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f13a7-eb05-4cdf-b429-074854963354 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.150965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:25.162457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1302/2591] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:25.166358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6072db-27e3-4309-9870-b78761c57476 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.176638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6072db-27e3-4309-9870-b78761c57476 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.181743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430f735-c6d1-4371-ac8d-87a39bce5684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.182405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430f735-c6d1-4371-ac8d-87a39bce5684 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.182683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430f735-c6d1-4371-ac8d-87a39bce5684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.182953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430f735-c6d1-4371-ac8d-87a39bce5684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.183681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430f735-c6d1-4371-ac8d-87a39bce5684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.185307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430f735-c6d1-4371-ac8d-87a39bce5684 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.195589 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1290/2592] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:25.199800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f13a7-eb05-4cdf-b429-074854963354 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.210952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f13a7-eb05-4cdf-b429-074854963354 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.216927 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024e0b-7673-40d3-8308-89261babb7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.217813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024e0b-7673-40d3-8308-89261babb7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.218090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024e0b-7673-40d3-8308-89261babb7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.218357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024e0b-7673-40d3-8308-89261babb7cc admin admin] PATH_INFO: `/v3/projects/623710eebaba4667abe1a7fc88332a1c/users/f92603f03dc746a6a2707da4b387ba6b/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.234117 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41024e0b-7673-40d3-8308-89261babb7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=623710eebaba4667abe1a7fc88332a1c, user_id=f92603f03dc746a6a2707da4b387ba6b, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.236843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41024e0b-7673-40d3-8308-89261babb7cc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.253765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1303/2593] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:25 2022] PUT /identity/v3/projects/623710eebaba4667abe1a7fc88332a1c/users/f92603f03dc746a6a2707da4b387ba6b/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:25.265867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9b626-1a9d-493b-ae5d-d3aec1670d2f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.266158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9b626-1a9d-493b-ae5d-d3aec1670d2f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.266439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9b626-1a9d-493b-ae5d-d3aec1670d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.297396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-79e9b626-1a9d-493b-ae5d-d3aec1670d2f None None] MFA Rules not processed for user `f92603f03dc746a6a2707da4b387ba6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:25.298662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-79e9b626-1a9d-493b-ae5d-d3aec1670d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:25.371491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1291/2594] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:25.376221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024e0b-7673-40d3-8308-89261babb7cc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.447141 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024e0b-7673-40d3-8308-89261babb7cc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.453740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a8ce3-5460-4573-9d47-c9806605e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.454409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a8ce3-5460-4573-9d47-c9806605e97e admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.454690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a8ce3-5460-4573-9d47-c9806605e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.454961 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a8ce3-5460-4573-9d47-c9806605e97e admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.455645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a8ce3-5460-4573-9d47-c9806605e97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.457600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a8ce3-5460-4573-9d47-c9806605e97e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.487592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1304/2595] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:25 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:25.491371 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9b626-1a9d-493b-ae5d-d3aec1670d2f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.502780 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9b626-1a9d-493b-ae5d-d3aec1670d2f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.568088 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090bb08-97af-4136-af03-17a9a2375f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.568895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090bb08-97af-4136-af03-17a9a2375f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.569510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090bb08-97af-4136-af03-17a9a2375f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.569795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090bb08-97af-4136-af03-17a9a2375f8f admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.570721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090bb08-97af-4136-af03-17a9a2375f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.572834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090bb08-97af-4136-af03-17a9a2375f8f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.599129 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1292/2596] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:25 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:25.604218 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a8ce3-5460-4573-9d47-c9806605e97e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.616699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a8ce3-5460-4573-9d47-c9806605e97e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.621335 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403c516-c24c-445a-8295-de12f5017b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.622005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c516-c24c-445a-8295-de12f5017b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.622274 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c516-c24c-445a-8295-de12f5017b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.622546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c516-c24c-445a-8295-de12f5017b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.623272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403c516-c24c-445a-8295-de12f5017b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.624896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403c516-c24c-445a-8295-de12f5017b21 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.636083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1305/2597] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:25.642798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090bb08-97af-4136-af03-17a9a2375f8f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.655000 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090bb08-97af-4136-af03-17a9a2375f8f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.659811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163e09-2c1d-455a-b0e5-6b956cdede1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.660890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163e09-2c1d-455a-b0e5-6b956cdede1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.661178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163e09-2c1d-455a-b0e5-6b956cdede1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.661481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163e09-2c1d-455a-b0e5-6b956cdede1c admin admin] PATH_INFO: `/v3/projects/a95bba3dd5834371bf01d63049443e7b/users/abe78b9cf2d943b3a02d7be446f1b48e/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.677473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7163e09-2c1d-455a-b0e5-6b956cdede1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95bba3dd5834371bf01d63049443e7b, user_id=abe78b9cf2d943b3a02d7be446f1b48e, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.680158 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7163e09-2c1d-455a-b0e5-6b956cdede1c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.694505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1293/2598] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:25 2022] PUT /identity/v3/projects/a95bba3dd5834371bf01d63049443e7b/users/abe78b9cf2d943b3a02d7be446f1b48e/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:25.698724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403c516-c24c-445a-8295-de12f5017b21 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.709306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403c516-c24c-445a-8295-de12f5017b21 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.770791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2f1f0-c18b-4175-b054-733fc5e39b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.771878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2f1f0-c18b-4175-b054-733fc5e39b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.772057 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2f1f0-c18b-4175-b054-733fc5e39b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.772334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2f1f0-c18b-4175-b054-733fc5e39b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.773121 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2f1f0-c18b-4175-b054-733fc5e39b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.774708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2f1f0-c18b-4175-b054-733fc5e39b59 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.784764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1306/2599] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:25.790270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163e09-2c1d-455a-b0e5-6b956cdede1c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.804847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163e09-2c1d-455a-b0e5-6b956cdede1c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.809977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faf4dd-6721-4fdb-b2b0-eaf05c77a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.810864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faf4dd-6721-4fdb-b2b0-eaf05c77a8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.811149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faf4dd-6721-4fdb-b2b0-eaf05c77a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.811426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faf4dd-6721-4fdb-b2b0-eaf05c77a8d6 admin admin] PATH_INFO: `/v3/projects/a95bba3dd5834371bf01d63049443e7b/users/abe78b9cf2d943b3a02d7be446f1b48e/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.813533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49faf4dd-6721-4fdb-b2b0-eaf05c77a8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95bba3dd5834371bf01d63049443e7b, user_id=abe78b9cf2d943b3a02d7be446f1b48e, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.816157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49faf4dd-6721-4fdb-b2b0-eaf05c77a8d6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.827390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1294/2600] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:25 2022] PUT /identity/v3/projects/a95bba3dd5834371bf01d63049443e7b/users/abe78b9cf2d943b3a02d7be446f1b48e/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:25.838661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72785273-54e6-4460-b6fe-77ee8cf63c01 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.839021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72785273-54e6-4460-b6fe-77ee8cf63c01 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.839395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72785273-54e6-4460-b6fe-77ee8cf63c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.871632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-72785273-54e6-4460-b6fe-77ee8cf63c01 None None] MFA Rules not processed for user `abe78b9cf2d943b3a02d7be446f1b48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:25.872904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-72785273-54e6-4460-b6fe-77ee8cf63c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:25.908095 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:25.948878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1307/2601] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:25.960239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faf4dd-6721-4fdb-b2b0-eaf05c77a8d6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.962402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-49faf4dd-6721-4fdb-b2b0-eaf05c77a8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:25.993069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:26.025617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faf4dd-6721-4fdb-b2b0-eaf05c77a8d6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:26.029512 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e47bc6-1b57-4699-9d61-3971102115a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:26.030162 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e47bc6-1b57-4699-9d61-3971102115a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.030442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e47bc6-1b57-4699-9d61-3971102115a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.030717 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e47bc6-1b57-4699-9d61-3971102115a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.041259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e47bc6-1b57-4699-9d61-3971102115a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:26.042694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e47bc6-1b57-4699-9d61-3971102115a6 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:26.060372 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1295/2602] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:26.643724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72785273-54e6-4460-b6fe-77ee8cf63c01 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:26.725734 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72785273-54e6-4460-b6fe-77ee8cf63c01 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:26.731295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:26.732257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.732533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.732837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] PATH_INFO: `/v3/users/f92603f03dc746a6a2707da4b387ba6b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.734091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92603f03dc746a6a2707da4b387ba6b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:26.736127 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:26.785729 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92603f03dc746a6a2707da4b387ba6b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:26.793977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92603f03dc746a6a2707da4b387ba6b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:26.794603 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92603f03dc746a6a2707da4b387ba6b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:26.801303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92603f03dc746a6a2707da4b387ba6b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:26.801913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92603f03dc746a6a2707da4b387ba6b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:26.820021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1308/2603] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:26 2022] DELETE /identity/v3/users/f92603f03dc746a6a2707da4b387ba6b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:26.824726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985c17-f1fd-47ec-80de-e6627bed6285 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.825197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985c17-f1fd-47ec-80de-e6627bed6285 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.825319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985c17-f1fd-47ec-80de-e6627bed6285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.845305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-17985c17-f1fd-47ec-80de-e6627bed6285 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:26.846496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-17985c17-f1fd-47ec-80de-e6627bed6285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:26.909457 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1296/2604] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:26.919970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:26.921575 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:26.980196 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:26.984204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e68b67-c9c5-4a1a-9bc6-0a4e1566ea50 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:26.989115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92b015-dd00-4f34-a3e4-32345072ead1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:26.989819 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92b015-dd00-4f34-a3e4-32345072ead1 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.990180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92b015-dd00-4f34-a3e4-32345072ead1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.990840 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92b015-dd00-4f34-a3e4-32345072ead1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:27.001412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92b015-dd00-4f34-a3e4-32345072ead1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:27.002862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92b015-dd00-4f34-a3e4-32345072ead1 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:27.013206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1309/2605] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:27.302134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985c17-f1fd-47ec-80de-e6627bed6285 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:27.303948 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-17985c17-f1fd-47ec-80de-e6627bed6285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:27.316907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985c17-f1fd-47ec-80de-e6627bed6285 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:27.324340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:27.325267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:27.325758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:27.325857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] PATH_INFO: `/v3/projects/623710eebaba4667abe1a7fc88332a1c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:27.327373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623710eebaba4667abe1a7fc88332a1c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:27.329314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:27.384322 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623710eebaba4667abe1a7fc88332a1c', 'request_id': 'req-96ea9de7-0aec-413c-855f-240f3aaf78f2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:27.392860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623710eebaba4667abe1a7fc88332a1c', 'request_id': 'req-96ea9de7-0aec-413c-855f-240f3aaf78f2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:27.399264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623710eebaba4667abe1a7fc88332a1c', 'request_id': 'req-96ea9de7-0aec-413c-855f-240f3aaf78f2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:27.409300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] The token cache is being invalidate because project 623710eebaba4667abe1a7fc88332a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:27.409587 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:27.410235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:27.411795 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1297/2606] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:27 2022] DELETE /identity/v3/projects/623710eebaba4667abe1a7fc88332a1c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:27.415910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92b015-dd00-4f34-a3e4-32345072ead1 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:27.425703 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92b015-dd00-4f34-a3e4-32345072ead1 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:27.486331 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:27.487250 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:27.487522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:27.487792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] PATH_INFO: `/v3/users/abe78b9cf2d943b3a02d7be446f1b48e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:27.489370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe78b9cf2d943b3a02d7be446f1b48e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:27.491372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:27.545072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe78b9cf2d943b3a02d7be446f1b48e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:27.554978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe78b9cf2d943b3a02d7be446f1b48e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:27.555905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe78b9cf2d943b3a02d7be446f1b48e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:27.564008 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe78b9cf2d943b3a02d7be446f1b48e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:27.564939 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c25bda61-669d-4d36-8d2c-1a0fd8abc134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe78b9cf2d943b3a02d7be446f1b48e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:27.582382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1310/2607] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:27 2022] DELETE /identity/v3/users/abe78b9cf2d943b3a02d7be446f1b48e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:27.863282 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:27.865192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:27.886550 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea9de7-0aec-413c-855f-240f3aaf78f2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:27.938330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:27.949885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:27.950965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:27.951460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:27.951735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] PATH_INFO: `/v3/projects/a95bba3dd5834371bf01d63049443e7b` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:27.952957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95bba3dd5834371bf01d63049443e7b)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:27.954881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.007629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95bba3dd5834371bf01d63049443e7b', 'request_id': 'req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:28.016007 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95bba3dd5834371bf01d63049443e7b', 'request_id': 'req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:28.023212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95bba3dd5834371bf01d63049443e7b', 'request_id': 'req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:28.034983 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] The token cache is being invalidate because project a95bba3dd5834371bf01d63049443e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:28.035269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:28.036013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f0192fc3-597a-4d9b-9a59-acfc5ae2ed42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:28.038547 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1298/2608] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:27 2022] DELETE /identity/v3/projects/a95bba3dd5834371bf01d63049443e7b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:28.043554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6ea53-1d38-4078-9a48-336a26c96c32 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.044031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6ea53-1d38-4078-9a48-336a26c96c32 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.044269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6ea53-1d38-4078-9a48-336a26c96c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.072311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-efe6ea53-1d38-4078-9a48-336a26c96c32 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:28.073779 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-efe6ea53-1d38-4078-9a48-336a26c96c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:28.141135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1311/2609] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:28.149761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfe431-429c-4097-8a15-76cf33d1689e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.150051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfe431-429c-4097-8a15-76cf33d1689e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.150356 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfe431-429c-4097-8a15-76cf33d1689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.169706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-dddfe431-429c-4097-8a15-76cf33d1689e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:28.170930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dddfe431-429c-4097-8a15-76cf33d1689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:28.179420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1299/2610] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:28.183741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6ea53-1d38-4078-9a48-336a26c96c32 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.194082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6ea53-1d38-4078-9a48-336a26c96c32 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.199104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c7d95-cca8-443b-9844-e791f7a5dcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.199759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c7d95-cca8-443b-9844-e791f7a5dcdf admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.200038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c7d95-cca8-443b-9844-e791f7a5dcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.200307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c7d95-cca8-443b-9844-e791f7a5dcdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.201064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c7d95-cca8-443b-9844-e791f7a5dcdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:28.201364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c7d95-cca8-443b-9844-e791f7a5dcdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.202966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c7d95-cca8-443b-9844-e791f7a5dcdf admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.209874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:28.216326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1312/2611] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:28.221031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfe431-429c-4097-8a15-76cf33d1689e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.230627 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfe431-429c-4097-8a15-76cf33d1689e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.235496 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a6932-edf2-458b-94cb-e2cacee03246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.236204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a6932-edf2-458b-94cb-e2cacee03246 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.236468 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a6932-edf2-458b-94cb-e2cacee03246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.236773 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a6932-edf2-458b-94cb-e2cacee03246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.237558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a6932-edf2-458b-94cb-e2cacee03246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.239509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a6932-edf2-458b-94cb-e2cacee03246 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.268747 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1300/2612] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:28 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:28.271964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c7d95-cca8-443b-9844-e791f7a5dcdf admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.285950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c7d95-cca8-443b-9844-e791f7a5dcdf admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.346649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b89f-02c9-4d0d-b42f-b8a407e67630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.347405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b89f-02c9-4d0d-b42f-b8a407e67630 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.347687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b89f-02c9-4d0d-b42f-b8a407e67630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.347964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b89f-02c9-4d0d-b42f-b8a407e67630 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.348781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6b89f-02c9-4d0d-b42f-b8a407e67630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.350844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6b89f-02c9-4d0d-b42f-b8a407e67630 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.373215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1313/2613] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:28 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:28.378277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a6932-edf2-458b-94cb-e2cacee03246 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.389412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a6932-edf2-458b-94cb-e2cacee03246 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.394159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832e1d-16a2-4883-a59a-f2a99f4795aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.395011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832e1d-16a2-4883-a59a-f2a99f4795aa admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.395299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832e1d-16a2-4883-a59a-f2a99f4795aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.395681 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832e1d-16a2-4883-a59a-f2a99f4795aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.396459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d832e1d-16a2-4883-a59a-f2a99f4795aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.398201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d832e1d-16a2-4883-a59a-f2a99f4795aa admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.408970 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1301/2614] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:28.413109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b89f-02c9-4d0d-b42f-b8a407e67630 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.423775 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b89f-02c9-4d0d-b42f-b8a407e67630 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.429699 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c7c83-634f-4a47-8065-448bcbaf58b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.430512 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7c83-634f-4a47-8065-448bcbaf58b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.430791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7c83-634f-4a47-8065-448bcbaf58b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.431070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7c83-634f-4a47-8065-448bcbaf58b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.431803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c7c83-634f-4a47-8065-448bcbaf58b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.433453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c7c83-634f-4a47-8065-448bcbaf58b4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.443757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1314/2615] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:28.447862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832e1d-16a2-4883-a59a-f2a99f4795aa admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.459267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832e1d-16a2-4883-a59a-f2a99f4795aa admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.464224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23368382-1528-4a19-a20a-c9bab96c1371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.465156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23368382-1528-4a19-a20a-c9bab96c1371 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.465443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23368382-1528-4a19-a20a-c9bab96c1371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.465744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23368382-1528-4a19-a20a-c9bab96c1371 admin admin] PATH_INFO: `/v3/projects/5cd99e856cd645d69d3b0083655a555f/users/722da9840fa3459ea1644ab2f029f35e/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.480932 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23368382-1528-4a19-a20a-c9bab96c1371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd99e856cd645d69d3b0083655a555f, user_id=722da9840fa3459ea1644ab2f029f35e, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.483597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23368382-1528-4a19-a20a-c9bab96c1371 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.498047 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1302/2616] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:28 2022] PUT /identity/v3/projects/5cd99e856cd645d69d3b0083655a555f/users/722da9840fa3459ea1644ab2f029f35e/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:28.510821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf82f7-35b3-4f9b-9724-1d9aba1e85b4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.511109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf82f7-35b3-4f9b-9724-1d9aba1e85b4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.511421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf82f7-35b3-4f9b-9724-1d9aba1e85b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.539911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5ebf82f7-35b3-4f9b-9724-1d9aba1e85b4 None None] MFA Rules not processed for user `722da9840fa3459ea1644ab2f029f35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:28.541149 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5ebf82f7-35b3-4f9b-9724-1d9aba1e85b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:28.614697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1315/2617] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:28.619289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23368382-1528-4a19-a20a-c9bab96c1371 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.691293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23368382-1528-4a19-a20a-c9bab96c1371 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.696381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf61f4-2a00-41ae-b075-170d2f43e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.697037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf61f4-2a00-41ae-b075-170d2f43e5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.697321 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf61f4-2a00-41ae-b075-170d2f43e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.697600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf61f4-2a00-41ae-b075-170d2f43e5b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.698309 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf61f4-2a00-41ae-b075-170d2f43e5b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.700219 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf61f4-2a00-41ae-b075-170d2f43e5b2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.728643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1303/2618] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:28 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:28.732891 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf82f7-35b3-4f9b-9724-1d9aba1e85b4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.744967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf82f7-35b3-4f9b-9724-1d9aba1e85b4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.809649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d12cf-4d93-47ee-b734-381d1e1002b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.810327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d12cf-4d93-47ee-b734-381d1e1002b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.810611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d12cf-4d93-47ee-b734-381d1e1002b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.810885 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d12cf-4d93-47ee-b734-381d1e1002b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.811566 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d12cf-4d93-47ee-b734-381d1e1002b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.813503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d12cf-4d93-47ee-b734-381d1e1002b7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.823122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:28.837147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1316/2619] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:28 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:28.841536 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf61f4-2a00-41ae-b075-170d2f43e5b2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.847524 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:28.855071 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf61f4-2a00-41ae-b075-170d2f43e5b2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.861157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3592-e300-46ee-940c-03fcaead2112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.861835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3592-e300-46ee-940c-03fcaead2112 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.862122 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3592-e300-46ee-940c-03fcaead2112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.862402 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3592-e300-46ee-940c-03fcaead2112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.863143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b3592-e300-46ee-940c-03fcaead2112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.864785 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b3592-e300-46ee-940c-03fcaead2112 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.877241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1304/2620] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:28.882136 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d12cf-4d93-47ee-b734-381d1e1002b7 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.893015 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d12cf-4d93-47ee-b734-381d1e1002b7 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.898359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15561815-6473-4f1e-ae9b-c9a7f40f2675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.899277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15561815-6473-4f1e-ae9b-c9a7f40f2675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.899563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15561815-6473-4f1e-ae9b-c9a7f40f2675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.899833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15561815-6473-4f1e-ae9b-c9a7f40f2675 admin admin] PATH_INFO: `/v3/projects/5e30c8e3ca4d46489e2e71c5bd805d03/users/bf7ad48d33b646059cd227facdf39e94/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.915632 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15561815-6473-4f1e-ae9b-c9a7f40f2675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e30c8e3ca4d46489e2e71c5bd805d03, user_id=bf7ad48d33b646059cd227facdf39e94, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.918334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15561815-6473-4f1e-ae9b-c9a7f40f2675 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.933559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1317/2621] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:28 2022] PUT /identity/v3/projects/5e30c8e3ca4d46489e2e71c5bd805d03/users/bf7ad48d33b646059cd227facdf39e94/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:28.938953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3592-e300-46ee-940c-03fcaead2112 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.949871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3592-e300-46ee-940c-03fcaead2112 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.022915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49c74a-236b-473e-9bd0-a76e30b1689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.023662 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c74a-236b-473e-9bd0-a76e30b1689b admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.023947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c74a-236b-473e-9bd0-a76e30b1689b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.024307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c74a-236b-473e-9bd0-a76e30b1689b admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.025072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49c74a-236b-473e-9bd0-a76e30b1689b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.026683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49c74a-236b-473e-9bd0-a76e30b1689b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.037917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1305/2622] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:29.042971 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15561815-6473-4f1e-ae9b-c9a7f40f2675 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:29.054288 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15561815-6473-4f1e-ae9b-c9a7f40f2675 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.060442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f8a4e-8499-4094-a6ad-cb4ad85988b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.061375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f8a4e-8499-4094-a6ad-cb4ad85988b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.061716 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f8a4e-8499-4094-a6ad-cb4ad85988b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.061994 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f8a4e-8499-4094-a6ad-cb4ad85988b9 admin admin] PATH_INFO: `/v3/projects/5e30c8e3ca4d46489e2e71c5bd805d03/users/bf7ad48d33b646059cd227facdf39e94/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.064147 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f8a4e-8499-4094-a6ad-cb4ad85988b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e30c8e3ca4d46489e2e71c5bd805d03, user_id=bf7ad48d33b646059cd227facdf39e94, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.066894 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f8a4e-8499-4094-a6ad-cb4ad85988b9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.078723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1318/2623] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:29 2022] PUT /identity/v3/projects/5e30c8e3ca4d46489e2e71c5bd805d03/users/bf7ad48d33b646059cd227facdf39e94/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:29.090471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd4e89-27ae-4dfd-a477-c2a1906f6278 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.090848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd4e89-27ae-4dfd-a477-c2a1906f6278 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.091194 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd4e89-27ae-4dfd-a477-c2a1906f6278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.120823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6fdd4e89-27ae-4dfd-a477-c2a1906f6278 None None] MFA Rules not processed for user `bf7ad48d33b646059cd227facdf39e94`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:29.122058 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6fdd4e89-27ae-4dfd-a477-c2a1906f6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:29.210145 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1306/2624] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:29.221893 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f8a4e-8499-4094-a6ad-cb4ad85988b9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:29.223723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4e2f8a4e-8499-4094-a6ad-cb4ad85988b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:29.287469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f8a4e-8499-4094-a6ad-cb4ad85988b9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.291855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcd745-a62d-4352-961a-b16e43729c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.292693 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd745-a62d-4352-961a-b16e43729c8e service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.292975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd745-a62d-4352-961a-b16e43729c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.293249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd745-a62d-4352-961a-b16e43729c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.358610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcd745-a62d-4352-961a-b16e43729c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.360053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcd745-a62d-4352-961a-b16e43729c8e service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.376462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1319/2625] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:33.642764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd4e89-27ae-4dfd-a477-c2a1906f6278 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:33.653657 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd4e89-27ae-4dfd-a477-c2a1906f6278 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:33.657288 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cd576-812e-4fac-b4e5-422abb5e2e2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:33.657933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cd576-812e-4fac-b4e5-422abb5e2e2e service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:33.658215 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cd576-812e-4fac-b4e5-422abb5e2e2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:33.658490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cd576-812e-4fac-b4e5-422abb5e2e2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:33.668680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cd576-812e-4fac-b4e5-422abb5e2e2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:33.670342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cd576-812e-4fac-b4e5-422abb5e2e2e service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:33.681068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1307/2626] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:38.611278 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcd745-a62d-4352-961a-b16e43729c8e service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:38.690841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcd745-a62d-4352-961a-b16e43729c8e service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:38.695285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:38.696135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:38.696398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:38.696685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] PATH_INFO: `/v3/users/722da9840fa3459ea1644ab2f029f35e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:38.698418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] RBAC: Authorizing `identity:delete_user(user_id=722da9840fa3459ea1644ab2f029f35e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:38.700346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:38.716061 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:38.753178 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722da9840fa3459ea1644ab2f029f35e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:38.762798 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722da9840fa3459ea1644ab2f029f35e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:38.763449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722da9840fa3459ea1644ab2f029f35e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:38.770942 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722da9840fa3459ea1644ab2f029f35e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:38.771590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722da9840fa3459ea1644ab2f029f35e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:38.792910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1320/2627] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:38 2022] DELETE /identity/v3/users/722da9840fa3459ea1644ab2f029f35e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:38.797684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19130e70-ac1f-4000-982d-775bf23cfbc0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:38.798163 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19130e70-ac1f-4000-982d-775bf23cfbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:38.798303 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19130e70-ac1f-4000-982d-775bf23cfbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:38.816299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-19130e70-ac1f-4000-982d-775bf23cfbc0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:38.817659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-19130e70-ac1f-4000-982d-775bf23cfbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:38.874965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:38.896021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1308/2628] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:38.908898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:38.910803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:38.977110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea770-7cd4-4e5c-8fbe-25b241c3c53a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:38.981363 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718f787-b651-449d-9d11-2635a605d2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:38.982046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718f787-b651-449d-9d11-2635a605d2bb service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:38.982326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718f787-b651-449d-9d11-2635a605d2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:38.982587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718f787-b651-449d-9d11-2635a605d2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:38.991886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718f787-b651-449d-9d11-2635a605d2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:38.993360 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718f787-b651-449d-9d11-2635a605d2bb service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:39.003773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1321/2629] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:39.027804 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19130e70-ac1f-4000-982d-775bf23cfbc0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:39.029317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-19130e70-ac1f-4000-982d-775bf23cfbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:39.042270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19130e70-ac1f-4000-982d-775bf23cfbc0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:39.047106 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:39.048034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.048316 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.048590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] PATH_INFO: `/v3/users/132e0be5c8364bc8a0f951acab41bc05` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.049865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132e0be5c8364bc8a0f951acab41bc05)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:39.051992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:39.104503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132e0be5c8364bc8a0f951acab41bc05'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.105231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132e0be5c8364bc8a0f951acab41bc05'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.114217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132e0be5c8364bc8a0f951acab41bc05'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.121850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132e0be5c8364bc8a0f951acab41bc05'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.122556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132e0be5c8364bc8a0f951acab41bc05'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.140745 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1309/2630] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:39 2022] DELETE /identity/v3/users/132e0be5c8364bc8a0f951acab41bc05 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:39.145445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d928ce-2b58-459d-b406-7e452bd67fa7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.145732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d928ce-2b58-459d-b406-7e452bd67fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.146004 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d928ce-2b58-459d-b406-7e452bd67fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.165090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-42d928ce-2b58-459d-b406-7e452bd67fa7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:39.166643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-42d928ce-2b58-459d-b406-7e452bd67fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:39.231899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1322/2631] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:39.241573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:39.243210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:39.290962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d928ce-2b58-459d-b406-7e452bd67fa7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:39.293019 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-42d928ce-2b58-459d-b406-7e452bd67fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:39.310346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d928ce-2b58-459d-b406-7e452bd67fa7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:39.317265 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:39.318169 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.318411 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.318677 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] PATH_INFO: `/v3/projects/5cd99e856cd645d69d3b0083655a555f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.319979 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd99e856cd645d69d3b0083655a555f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:39.320797 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dafc4d-24ad-4684-9e5c-a35c94f5ae84 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:39.321948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:39.324847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562cab3-2113-4559-a88d-f061bbe85f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:39.325474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562cab3-2113-4559-a88d-f061bbe85f52 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.325906 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562cab3-2113-4559-a88d-f061bbe85f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.326187 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562cab3-2113-4559-a88d-f061bbe85f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.336097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562cab3-2113-4559-a88d-f061bbe85f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:39.337558 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562cab3-2113-4559-a88d-f061bbe85f52 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:39.347760 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1310/2632] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:39.360624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:39.381258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd99e856cd645d69d3b0083655a555f', 'request_id': 'req-34fd9028-4ad5-40ae-83d3-4249d0ad0796'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.387197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd99e856cd645d69d3b0083655a555f', 'request_id': 'req-34fd9028-4ad5-40ae-83d3-4249d0ad0796'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.396471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd99e856cd645d69d3b0083655a555f', 'request_id': 'req-34fd9028-4ad5-40ae-83d3-4249d0ad0796'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.409025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] The token cache is being invalidate because project 5cd99e856cd645d69d3b0083655a555f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:39.409311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.410064 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.412167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1323/2633] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:39 2022] DELETE /identity/v3/projects/5cd99e856cd645d69d3b0083655a555f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:39.416066 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562cab3-2113-4559-a88d-f061bbe85f52 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:39.426640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562cab3-2113-4559-a88d-f061bbe85f52 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:39.488775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:39.489695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.490613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.490898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] PATH_INFO: `/v3/users/bf7ad48d33b646059cd227facdf39e94` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.492213 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7ad48d33b646059cd227facdf39e94)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:39.494872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:39.517923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:39.551380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7ad48d33b646059cd227facdf39e94'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.552064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7ad48d33b646059cd227facdf39e94'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.560159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7ad48d33b646059cd227facdf39e94'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.567865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7ad48d33b646059cd227facdf39e94'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.568541 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7ad48d33b646059cd227facdf39e94'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.588157 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1311/2634] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:39 2022] DELETE /identity/v3/users/bf7ad48d33b646059cd227facdf39e94 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:39.640384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:39.643434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:39.666509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd9028-4ad5-40ae-83d3-4249d0ad0796 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:39.734373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:39.737073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.737073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.737073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] PATH_INFO: `/v3/projects/ad3d3cc107ff4824bf8c052ebf921ca2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.739059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3d3cc107ff4824bf8c052ebf921ca2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:39.741157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:39.798406 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3d3cc107ff4824bf8c052ebf921ca2', 'request_id': 'req-51f7ec7b-54f3-4756-94e9-47eec575c4a4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.804116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3d3cc107ff4824bf8c052ebf921ca2', 'request_id': 'req-51f7ec7b-54f3-4756-94e9-47eec575c4a4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.813042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3d3cc107ff4824bf8c052ebf921ca2', 'request_id': 'req-51f7ec7b-54f3-4756-94e9-47eec575c4a4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.825666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] The token cache is being invalidate because project ad3d3cc107ff4824bf8c052ebf921ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:39.826033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.826759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.828306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1324/2635] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:39 2022] DELETE /identity/v3/projects/ad3d3cc107ff4824bf8c052ebf921ca2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:39.832379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:39.833935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:39.847777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31d849-dcf1-48d3-a058-d4dd55c96b11 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:39.874755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:39.876804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:39.913770 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:39.914666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.914949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.915231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] PATH_INFO: `/v3/users/d6431a0179a34b22b6cddbaf8e680e3c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.916799 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6431a0179a34b22b6cddbaf8e680e3c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:39.918807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:39.933640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:39.949950 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ec7b-54f3-4756-94e9-47eec575c4a4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:39.954773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:39.955645 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.955921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.956188 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] PATH_INFO: `/v3/projects/5e30c8e3ca4d46489e2e71c5bd805d03` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.957479 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e30c8e3ca4d46489e2e71c5bd805d03)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:39.959372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:39.967753 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6431a0179a34b22b6cddbaf8e680e3c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.968400 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6431a0179a34b22b6cddbaf8e680e3c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.976818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6431a0179a34b22b6cddbaf8e680e3c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.984442 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6431a0179a34b22b6cddbaf8e680e3c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:39.985217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e1a69bf8-f061-453e-88e7-0a666e839b80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6431a0179a34b22b6cddbaf8e680e3c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.003531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1312/2636] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:39 2022] DELETE /identity/v3/users/d6431a0179a34b22b6cddbaf8e680e3c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:40.011392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e30c8e3ca4d46489e2e71c5bd805d03', 'request_id': 'req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.017963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e30c8e3ca4d46489e2e71c5bd805d03', 'request_id': 'req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.026862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e30c8e3ca4d46489e2e71c5bd805d03', 'request_id': 'req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.038638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] The token cache is being invalidate because project 5e30c8e3ca4d46489e2e71c5bd805d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:40.038924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.039590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fa6ee07c-9ef5-4551-8f46-d2c89482ad54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.041747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1325/2637] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:39 2022] DELETE /identity/v3/projects/5e30c8e3ca4d46489e2e71c5bd805d03 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:40.047696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394cb68-3bd9-462c-96b2-4612ac3e2424 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.048001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394cb68-3bd9-462c-96b2-4612ac3e2424 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.048267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394cb68-3bd9-462c-96b2-4612ac3e2424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.069324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2394cb68-3bd9-462c-96b2-4612ac3e2424 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:40.070618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2394cb68-3bd9-462c-96b2-4612ac3e2424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:40.080985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.135057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1313/2638] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:40.143877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e93968-86b1-4c11-bfd8-286fd34f1b71 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.144164 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e93968-86b1-4c11-bfd8-286fd34f1b71 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.144444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e93968-86b1-4c11-bfd8-286fd34f1b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.175389 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-92e93968-86b1-4c11-bfd8-286fd34f1b71 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:40.176691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-92e93968-86b1-4c11-bfd8-286fd34f1b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:40.185855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1326/2639] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:40.190510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394cb68-3bd9-462c-96b2-4612ac3e2424 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.201482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394cb68-3bd9-462c-96b2-4612ac3e2424 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.206099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69858f7-b197-4dcc-8d2f-fab87bec780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.206767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69858f7-b197-4dcc-8d2f-fab87bec780b admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.207054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69858f7-b197-4dcc-8d2f-fab87bec780b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.207328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69858f7-b197-4dcc-8d2f-fab87bec780b admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.208173 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69858f7-b197-4dcc-8d2f-fab87bec780b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:40.208477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69858f7-b197-4dcc-8d2f-fab87bec780b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.210111 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69858f7-b197-4dcc-8d2f-fab87bec780b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.223198 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1314/2640] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:40.227810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e93968-86b1-4c11-bfd8-286fd34f1b71 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.237686 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e93968-86b1-4c11-bfd8-286fd34f1b71 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.242445 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f6a96-7304-4e71-a4aa-b1fc35d181a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.243111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f6a96-7304-4e71-a4aa-b1fc35d181a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.243392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f6a96-7304-4e71-a4aa-b1fc35d181a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.243665 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f6a96-7304-4e71-a4aa-b1fc35d181a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.245988 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f6a96-7304-4e71-a4aa-b1fc35d181a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.246587 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f6a96-7304-4e71-a4aa-b1fc35d181a2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.280115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1327/2641] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:40.281429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69858f7-b197-4dcc-8d2f-fab87bec780b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.292184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f6a96-7304-4e71-a4aa-b1fc35d181a2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.294276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-954f6a96-7304-4e71-a4aa-b1fc35d181a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:40.296818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69858f7-b197-4dcc-8d2f-fab87bec780b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.364227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80694e-f6e5-4e56-98ae-be73ea9dda7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.364952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80694e-f6e5-4e56-98ae-be73ea9dda7a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.365256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80694e-f6e5-4e56-98ae-be73ea9dda7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.365526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80694e-f6e5-4e56-98ae-be73ea9dda7a admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.366330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80694e-f6e5-4e56-98ae-be73ea9dda7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.368118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80694e-f6e5-4e56-98ae-be73ea9dda7a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.368889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f6a96-7304-4e71-a4aa-b1fc35d181a2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.374345 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.375484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.375896 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.376235 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] PATH_INFO: `/v3/projects/09950e8cb7cb4e69a1f31b945d87e8ab` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.377666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=09950e8cb7cb4e69a1f31b945d87e8ab)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.379762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.389690 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1315/2642] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:40.393969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80694e-f6e5-4e56-98ae-be73ea9dda7a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.403825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80694e-f6e5-4e56-98ae-be73ea9dda7a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.408641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445974-7800-491a-888d-c9eedccf897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.409324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445974-7800-491a-888d-c9eedccf897a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.409612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445974-7800-491a-888d-c9eedccf897a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.409907 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445974-7800-491a-888d-c9eedccf897a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.410664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2445974-7800-491a-888d-c9eedccf897a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.412266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2445974-7800-491a-888d-c9eedccf897a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.423287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1316/2643] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:40.428398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445974-7800-491a-888d-c9eedccf897a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.431099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09950e8cb7cb4e69a1f31b945d87e8ab', 'request_id': 'req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.433284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.437945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09950e8cb7cb4e69a1f31b945d87e8ab', 'request_id': 'req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.438634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445974-7800-491a-888d-c9eedccf897a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.446982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09950e8cb7cb4e69a1f31b945d87e8ab', 'request_id': 'req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.459124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] The token cache is being invalidate because project 09950e8cb7cb4e69a1f31b945d87e8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:40.459781 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.460428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c1d0040d-cbb4-4f66-8046-183f95c1b2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:40.462289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1328/2644] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:40 2022] DELETE /identity/v3/projects/09950e8cb7cb4e69a1f31b945d87e8ab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:40.467582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09624501-3cb8-4839-82f4-16a3077f6d25 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.467873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09624501-3cb8-4839-82f4-16a3077f6d25 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.468153 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09624501-3cb8-4839-82f4-16a3077f6d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.487313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-09624501-3cb8-4839-82f4-16a3077f6d25 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:40.488567 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-09624501-3cb8-4839-82f4-16a3077f6d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:40.500499 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d27ab-12e7-48c4-91af-3880d2074a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.501656 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d27ab-12e7-48c4-91af-3880d2074a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.501656 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d27ab-12e7-48c4-91af-3880d2074a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.501956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d27ab-12e7-48c4-91af-3880d2074a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.502484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d27ab-12e7-48c4-91af-3880d2074a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.504131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d27ab-12e7-48c4-91af-3880d2074a19 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.514577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1317/2645] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:40.519169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d27ab-12e7-48c4-91af-3880d2074a19 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.521112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1a1d27ab-12e7-48c4-91af-3880d2074a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:40.534214 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d27ab-12e7-48c4-91af-3880d2074a19 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.539033 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25e5ae-126b-4f79-88c8-f2435970e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.539908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25e5ae-126b-4f79-88c8-f2435970e989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.540189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25e5ae-126b-4f79-88c8-f2435970e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.540465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25e5ae-126b-4f79-88c8-f2435970e989 admin admin] PATH_INFO: `/v3/projects/78e5b138487d487b9f6acfb7851204c1/users/eb458f9a35c948cdabbcad6129f84496/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.549975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1329/2646] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:40.552826 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.556276 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25e5ae-126b-4f79-88c8-f2435970e989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e5b138487d487b9f6acfb7851204c1, user_id=eb458f9a35c948cdabbcad6129f84496, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.559123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b9420-488d-41e0-a7d5-47496b01328c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.559263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25e5ae-126b-4f79-88c8-f2435970e989 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.559424 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b9420-488d-41e0-a7d5-47496b01328c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.559695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b9420-488d-41e0-a7d5-47496b01328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.574365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1318/2647] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:40 2022] PUT /identity/v3/projects/78e5b138487d487b9f6acfb7851204c1/users/eb458f9a35c948cdabbcad6129f84496/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:40.578026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-275b9420-488d-41e0-a7d5-47496b01328c None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:40.579257 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-275b9420-488d-41e0-a7d5-47496b01328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:40.585340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787463-047b-4bf8-8ae3-93e1dceda74f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.585621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787463-047b-4bf8-8ae3-93e1dceda74f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.585892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787463-047b-4bf8-8ae3-93e1dceda74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.611823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0f787463-047b-4bf8-8ae3-93e1dceda74f None None] MFA Rules not processed for user `eb458f9a35c948cdabbcad6129f84496`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:40.613015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0f787463-047b-4bf8-8ae3-93e1dceda74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:40.641882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1330/2648] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:40.646072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b9420-488d-41e0-a7d5-47496b01328c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.657026 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b9420-488d-41e0-a7d5-47496b01328c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.661957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd538b-8963-4c33-bd73-c8aac9f7b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.663158 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd538b-8963-4c33-bd73-c8aac9f7b1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.663447 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd538b-8963-4c33-bd73-c8aac9f7b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.663725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd538b-8963-4c33-bd73-c8aac9f7b1ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.664452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd538b-8963-4c33-bd73-c8aac9f7b1ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:40.664778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd538b-8963-4c33-bd73-c8aac9f7b1ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.666413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd538b-8963-4c33-bd73-c8aac9f7b1ed admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.678894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1319/2649] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:40.679059 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1331/2650] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:40.683892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f787463-047b-4bf8-8ae3-93e1dceda74f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.684471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd538b-8963-4c33-bd73-c8aac9f7b1ed admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.694710 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd538b-8963-4c33-bd73-c8aac9f7b1ed admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.695114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f787463-047b-4bf8-8ae3-93e1dceda74f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.699820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224e16e-4b21-4dce-bc75-f355d720dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.700373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34a593-09da-4cf1-be04-cf465b8d961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.700529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224e16e-4b21-4dce-bc75-f355d720dd2b admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.700762 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224e16e-4b21-4dce-bc75-f355d720dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.701032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224e16e-4b21-4dce-bc75-f355d720dd2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.701322 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a593-09da-4cf1-be04-cf465b8d961d admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.701641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a593-09da-4cf1-be04-cf465b8d961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.701749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224e16e-4b21-4dce-bc75-f355d720dd2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.701923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a593-09da-4cf1-be04-cf465b8d961d admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.702677 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34a593-09da-4cf1-be04-cf465b8d961d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.703574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224e16e-4b21-4dce-bc75-f355d720dd2b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.704568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34a593-09da-4cf1-be04-cf465b8d961d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.731031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1332/2651] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:40.735203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1320/2652] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:40.736039 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224e16e-4b21-4dce-bc75-f355d720dd2b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.736169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34a593-09da-4cf1-be04-cf465b8d961d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.785009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.800012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34a593-09da-4cf1-be04-cf465b8d961d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.800841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224e16e-4b21-4dce-bc75-f355d720dd2b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.804582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598012a-49d8-4579-b26e-3e6e59923ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.805281 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598012a-49d8-4579-b26e-3e6e59923ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.805414 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0d6ae-9015-4cfb-9fef-f8f5237762a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.805561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598012a-49d8-4579-b26e-3e6e59923ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.805832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598012a-49d8-4579-b26e-3e6e59923ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.806014 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0d6ae-9015-4cfb-9fef-f8f5237762a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.806295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0d6ae-9015-4cfb-9fef-f8f5237762a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.806563 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598012a-49d8-4579-b26e-3e6e59923ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.807134 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0d6ae-9015-4cfb-9fef-f8f5237762a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.807504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0d6ae-9015-4cfb-9fef-f8f5237762a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.808459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598012a-49d8-4579-b26e-3e6e59923ab5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.809428 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0d6ae-9015-4cfb-9fef-f8f5237762a2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.830374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1321/2653] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:40.834360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598012a-49d8-4579-b26e-3e6e59923ab5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.837314 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1333/2654] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:40.842628 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0d6ae-9015-4cfb-9fef-f8f5237762a2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.845034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598012a-49d8-4579-b26e-3e6e59923ab5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.849856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de84adf-bf29-4308-8de7-bd1f9c37ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.850531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de84adf-bf29-4308-8de7-bd1f9c37ebeb admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.850816 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de84adf-bf29-4308-8de7-bd1f9c37ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.851091 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de84adf-bf29-4308-8de7-bd1f9c37ebeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.851823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de84adf-bf29-4308-8de7-bd1f9c37ebeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.852749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0d6ae-9015-4cfb-9fef-f8f5237762a2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.853585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de84adf-bf29-4308-8de7-bd1f9c37ebeb admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.857982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92f425-2aa0-49bf-a887-1c8bf036f88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.858638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92f425-2aa0-49bf-a887-1c8bf036f88c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.858922 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92f425-2aa0-49bf-a887-1c8bf036f88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.859221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92f425-2aa0-49bf-a887-1c8bf036f88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.859949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92f425-2aa0-49bf-a887-1c8bf036f88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.861644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92f425-2aa0-49bf-a887-1c8bf036f88c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.863728 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1322/2655] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:40.867573 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de84adf-bf29-4308-8de7-bd1f9c37ebeb admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.872528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1334/2656] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:40.876192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92f425-2aa0-49bf-a887-1c8bf036f88c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.877219 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de84adf-bf29-4308-8de7-bd1f9c37ebeb admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.881936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab629ac5-6013-4f80-840d-484cfb189b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.882593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629ac5-6013-4f80-840d-484cfb189b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.882877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629ac5-6013-4f80-840d-484cfb189b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.883156 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629ac5-6013-4f80-840d-484cfb189b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.883881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab629ac5-6013-4f80-840d-484cfb189b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.885577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab629ac5-6013-4f80-840d-484cfb189b2f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.886469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92f425-2aa0-49bf-a887-1c8bf036f88c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.891380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a0a53-0ce2-47eb-a7ce-f06f36150dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.892189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a0a53-0ce2-47eb-a7ce-f06f36150dff admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.892435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a0a53-0ce2-47eb-a7ce-f06f36150dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.892738 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a0a53-0ce2-47eb-a7ce-f06f36150dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.893458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a0a53-0ce2-47eb-a7ce-f06f36150dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.895044 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a0a53-0ce2-47eb-a7ce-f06f36150dff admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.897075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1323/2657] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:40.900984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab629ac5-6013-4f80-840d-484cfb189b2f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.909546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1335/2658] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:40.910761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a0a53-0ce2-47eb-a7ce-f06f36150dff admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.911447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab629ac5-6013-4f80-840d-484cfb189b2f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.916609 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd0b01-fa0e-451f-b3f7-699cacaf2c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.917345 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0b01-fa0e-451f-b3f7-699cacaf2c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.917618 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0b01-fa0e-451f-b3f7-699cacaf2c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.917886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0b01-fa0e-451f-b3f7-699cacaf2c71 admin admin] PATH_INFO: `/v3/projects/22f21c60c4264fdcabc0a378be9b7920/users/7c6eec6ce40c46fca50f09549b8608a2/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.921123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a0a53-0ce2-47eb-a7ce-f06f36150dff admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.926009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fb64d-29ae-424d-986a-8e1e83ac1500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.926962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb64d-29ae-424d-986a-8e1e83ac1500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.927319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb64d-29ae-424d-986a-8e1e83ac1500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.927673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb64d-29ae-424d-986a-8e1e83ac1500 admin admin] PATH_INFO: `/v3/projects/4c480a37d4514da6bdcffbe1845bb619/users/72be272d056442a8a958a67f20893495/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.933289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd0b01-fa0e-451f-b3f7-699cacaf2c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f21c60c4264fdcabc0a378be9b7920, user_id=7c6eec6ce40c46fca50f09549b8608a2, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.935894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd0b01-fa0e-451f-b3f7-699cacaf2c71 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.943911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fb64d-29ae-424d-986a-8e1e83ac1500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c480a37d4514da6bdcffbe1845bb619, user_id=72be272d056442a8a958a67f20893495, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.946763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fb64d-29ae-424d-986a-8e1e83ac1500 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.949976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1324/2659] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:40 2022] PUT /identity/v3/projects/22f21c60c4264fdcabc0a378be9b7920/users/7c6eec6ce40c46fca50f09549b8608a2/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:40.960555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9645c-2487-4f5c-acf0-dc2d0e245a61 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.960871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9645c-2487-4f5c-acf0-dc2d0e245a61 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.961148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9645c-2487-4f5c-acf0-dc2d0e245a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.967519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.969427 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1336/2660] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:40 2022] PUT /identity/v3/projects/4c480a37d4514da6bdcffbe1845bb619/users/72be272d056442a8a958a67f20893495/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:40.971293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad82f8-97a1-4dbc-907a-75fc23dd5ff8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.971652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad82f8-97a1-4dbc-907a-75fc23dd5ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.972001 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad82f8-97a1-4dbc-907a-75fc23dd5ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.992185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-05c9645c-2487-4f5c-acf0-dc2d0e245a61 None None] MFA Rules not processed for user `7c6eec6ce40c46fca50f09549b8608a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:40.993426 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-05c9645c-2487-4f5c-acf0-dc2d0e245a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:40.998736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-84ad82f8-97a1-4dbc-907a-75fc23dd5ff8 None None] MFA Rules not processed for user `72be272d056442a8a958a67f20893495`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:40.999964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-84ad82f8-97a1-4dbc-907a-75fc23dd5ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:41.061510 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1325/2661] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:41.065664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9645c-2487-4f5c-acf0-dc2d0e245a61 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.069763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1337/2662] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:41.074201 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad82f8-97a1-4dbc-907a-75fc23dd5ff8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.129143 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9645c-2487-4f5c-acf0-dc2d0e245a61 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.133688 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83d3d3-1d0e-440f-aa1a-67499dc7e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.134345 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d3d3-1d0e-440f-aa1a-67499dc7e515 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.134720 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d3d3-1d0e-440f-aa1a-67499dc7e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.134999 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d3d3-1d0e-440f-aa1a-67499dc7e515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.135692 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d3d3-1d0e-440f-aa1a-67499dc7e515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.137649 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d3d3-1d0e-440f-aa1a-67499dc7e515 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.139285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad82f8-97a1-4dbc-907a-75fc23dd5ff8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.144055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e764e4c-0140-4f1f-a009-ffafe320c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.144745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e764e4c-0140-4f1f-a009-ffafe320c8ec admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.145028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e764e4c-0140-4f1f-a009-ffafe320c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.145326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e764e4c-0140-4f1f-a009-ffafe320c8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.146407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e764e4c-0140-4f1f-a009-ffafe320c8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.147940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e764e4c-0140-4f1f-a009-ffafe320c8ec admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.165502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1326/2663] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:41 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:41.169658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83d3d3-1d0e-440f-aa1a-67499dc7e515 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.176394 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1338/2664] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:41 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:41.180400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e764e4c-0140-4f1f-a009-ffafe320c8ec admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.186444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.237236 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83d3d3-1d0e-440f-aa1a-67499dc7e515 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.242015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b895611-3b9f-46a3-bb3b-df98f5ec5bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.242693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b895611-3b9f-46a3-bb3b-df98f5ec5bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.242987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b895611-3b9f-46a3-bb3b-df98f5ec5bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.243252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b895611-3b9f-46a3-bb3b-df98f5ec5bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.244016 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b895611-3b9f-46a3-bb3b-df98f5ec5bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.245484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e764e4c-0140-4f1f-a009-ffafe320c8ec admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.246235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b895611-3b9f-46a3-bb3b-df98f5ec5bd0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.250042 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810afcb-d6ac-4eeb-a402-efe5cee3ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.250709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810afcb-d6ac-4eeb-a402-efe5cee3ea72 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.250990 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810afcb-d6ac-4eeb-a402-efe5cee3ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.251262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810afcb-d6ac-4eeb-a402-efe5cee3ea72 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.251945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810afcb-d6ac-4eeb-a402-efe5cee3ea72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.253858 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810afcb-d6ac-4eeb-a402-efe5cee3ea72 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.268871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1327/2665] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:41 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:41.271807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b895611-3b9f-46a3-bb3b-df98f5ec5bd0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.275111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1339/2666] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:41 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:41.279155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810afcb-d6ac-4eeb-a402-efe5cee3ea72 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.282123 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b895611-3b9f-46a3-bb3b-df98f5ec5bd0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.288585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715dbd-4971-47d6-aee6-6feaa470ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.289411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715dbd-4971-47d6-aee6-6feaa470ab49 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.289766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715dbd-4971-47d6-aee6-6feaa470ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.290109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715dbd-4971-47d6-aee6-6feaa470ab49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.290368 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810afcb-d6ac-4eeb-a402-efe5cee3ea72 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.291180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715dbd-4971-47d6-aee6-6feaa470ab49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.292971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715dbd-4971-47d6-aee6-6feaa470ab49 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.294493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.295255 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568813d-0651-41d5-b714-36fab18ee461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.295936 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568813d-0651-41d5-b714-36fab18ee461 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.296269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568813d-0651-41d5-b714-36fab18ee461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.296573 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568813d-0651-41d5-b714-36fab18ee461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.297409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568813d-0651-41d5-b714-36fab18ee461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.299005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568813d-0651-41d5-b714-36fab18ee461 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.306375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1328/2667] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:41.310552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715dbd-4971-47d6-aee6-6feaa470ab49 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.313045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1340/2668] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:41.316882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568813d-0651-41d5-b714-36fab18ee461 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.320782 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715dbd-4971-47d6-aee6-6feaa470ab49 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.326326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3181-2cb5-4df2-a0c6-5b4592b459c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.327197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568813d-0651-41d5-b714-36fab18ee461 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.327311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3181-2cb5-4df2-a0c6-5b4592b459c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.327474 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3181-2cb5-4df2-a0c6-5b4592b459c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.327746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3181-2cb5-4df2-a0c6-5b4592b459c5 admin admin] PATH_INFO: `/v3/projects/a6b9718c0a7549539111ba7f7d60bdf0/users/ba1bbf958f2a42b29dffcb057fc02ec4/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.332620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4adc8-65c7-4d2d-9940-4ca46faab32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.333532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4adc8-65c7-4d2d-9940-4ca46faab32f admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.333810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4adc8-65c7-4d2d-9940-4ca46faab32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.334084 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4adc8-65c7-4d2d-9940-4ca46faab32f admin admin] PATH_INFO: `/v3/projects/1173591e51aa4bbdaa7166f1e1830912/users/ab03dbabe6ff406c8d52fd665ee959d2/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.343802 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e3181-2cb5-4df2-a0c6-5b4592b459c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b9718c0a7549539111ba7f7d60bdf0, user_id=ba1bbf958f2a42b29dffcb057fc02ec4, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.346577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e3181-2cb5-4df2-a0c6-5b4592b459c5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.349709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4adc8-65c7-4d2d-9940-4ca46faab32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1173591e51aa4bbdaa7166f1e1830912, user_id=ab03dbabe6ff406c8d52fd665ee959d2, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.352354 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4adc8-65c7-4d2d-9940-4ca46faab32f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.361708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1329/2669] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:41 2022] PUT /identity/v3/projects/a6b9718c0a7549539111ba7f7d60bdf0/users/ba1bbf958f2a42b29dffcb057fc02ec4/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:41.365338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1341/2670] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:41 2022] PUT /identity/v3/projects/1173591e51aa4bbdaa7166f1e1830912/users/ab03dbabe6ff406c8d52fd665ee959d2/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:41.369971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3181-2cb5-4df2-a0c6-5b4592b459c5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.371206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4adc8-65c7-4d2d-9940-4ca46faab32f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.436088 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3181-2cb5-4df2-a0c6-5b4592b459c5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.440090 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4adc8-65c7-4d2d-9940-4ca46faab32f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.440858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0326-9e58-463c-a7c2-acea0e81b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.441529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0326-9e58-463c-a7c2-acea0e81b54b admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.441827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0326-9e58-463c-a7c2-acea0e81b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.442099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0326-9e58-463c-a7c2-acea0e81b54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.442855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b0326-9e58-463c-a7c2-acea0e81b54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.444443 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b0326-9e58-463c-a7c2-acea0e81b54b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.444794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e83e8a-8b83-4c2d-b63f-4398194f77f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.445462 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e83e8a-8b83-4c2d-b63f-4398194f77f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.445748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e83e8a-8b83-4c2d-b63f-4398194f77f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.446050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e83e8a-8b83-4c2d-b63f-4398194f77f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.446780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e83e8a-8b83-4c2d-b63f-4398194f77f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.448497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e83e8a-8b83-4c2d-b63f-4398194f77f0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.455068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1330/2671] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:41.458772 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0326-9e58-463c-a7c2-acea0e81b54b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.458911 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1342/2672] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:41.462806 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e83e8a-8b83-4c2d-b63f-4398194f77f0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.468899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0326-9e58-463c-a7c2-acea0e81b54b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.472694 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e83e8a-8b83-4c2d-b63f-4398194f77f0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.473461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f987237-2ddf-4a22-a302-94e6f4a921d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.474340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f987237-2ddf-4a22-a302-94e6f4a921d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.474617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f987237-2ddf-4a22-a302-94e6f4a921d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.474890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f987237-2ddf-4a22-a302-94e6f4a921d3 admin admin] PATH_INFO: `/v3/projects/1173591e51aa4bbdaa7166f1e1830912/users/ab03dbabe6ff406c8d52fd665ee959d2/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.477023 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f987237-2ddf-4a22-a302-94e6f4a921d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1173591e51aa4bbdaa7166f1e1830912, user_id=ab03dbabe6ff406c8d52fd665ee959d2, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.477446 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074311f-4f7a-4b23-b7d1-1dc07531b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.478418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074311f-4f7a-4b23-b7d1-1dc07531b5da admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.478703 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074311f-4f7a-4b23-b7d1-1dc07531b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.478981 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074311f-4f7a-4b23-b7d1-1dc07531b5da admin admin] PATH_INFO: `/v3/projects/a6b9718c0a7549539111ba7f7d60bdf0/users/ba1bbf958f2a42b29dffcb057fc02ec4/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.479771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f987237-2ddf-4a22-a302-94e6f4a921d3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.481084 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074311f-4f7a-4b23-b7d1-1dc07531b5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b9718c0a7549539111ba7f7d60bdf0, user_id=ba1bbf958f2a42b29dffcb057fc02ec4, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.483850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074311f-4f7a-4b23-b7d1-1dc07531b5da admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.492715 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1331/2673] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:41 2022] PUT /identity/v3/projects/1173591e51aa4bbdaa7166f1e1830912/users/ab03dbabe6ff406c8d52fd665ee959d2/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:41.496763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1343/2674] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:41 2022] PUT /identity/v3/projects/a6b9718c0a7549539111ba7f7d60bdf0/users/ba1bbf958f2a42b29dffcb057fc02ec4/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:41.510180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3aec4-354b-4eff-a815-fb63019a5b03 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.510447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3aec4-354b-4eff-a815-fb63019a5b03 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.510763 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3aec4-354b-4eff-a815-fb63019a5b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.543317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7fa3aec4-354b-4eff-a815-fb63019a5b03 None None] MFA Rules not processed for user `ba1bbf958f2a42b29dffcb057fc02ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:41.544567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7fa3aec4-354b-4eff-a815-fb63019a5b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:41.582763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdde21-6325-45ee-bd66-80178a7a9848 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.583035 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdde21-6325-45ee-bd66-80178a7a9848 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.583318 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdde21-6325-45ee-bd66-80178a7a9848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.620349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-60cdde21-6325-45ee-bd66-80178a7a9848 None None] MFA Rules not processed for user `ab03dbabe6ff406c8d52fd665ee959d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:41.622272 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-60cdde21-6325-45ee-bd66-80178a7a9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:41.640577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1332/2675] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:41.651925 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3aec4-354b-4eff-a815-fb63019a5b03 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.653584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7fa3aec4-354b-4eff-a815-fb63019a5b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:41.662262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.704629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1344/2676] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:41.707396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.716846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdde21-6325-45ee-bd66-80178a7a9848 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.718305 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-60cdde21-6325-45ee-bd66-80178a7a9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:41.726082 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3aec4-354b-4eff-a815-fb63019a5b03 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.730364 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761078bc-962e-4001-a468-e51a8d94beeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.731062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761078bc-962e-4001-a468-e51a8d94beeb service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.731349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761078bc-962e-4001-a468-e51a8d94beeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.731528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdde21-6325-45ee-bd66-80178a7a9848 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.731646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761078bc-962e-4001-a468-e51a8d94beeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.735643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4837f3-ad28-463a-8077-65802c264758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.736300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4837f3-ad28-463a-8077-65802c264758 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.736605 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4837f3-ad28-463a-8077-65802c264758 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.736906 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4837f3-ad28-463a-8077-65802c264758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.798275 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761078bc-962e-4001-a468-e51a8d94beeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.799730 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4837f3-ad28-463a-8077-65802c264758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.799923 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761078bc-962e-4001-a468-e51a8d94beeb service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.801200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4837f3-ad28-463a-8077-65802c264758 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.811359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1333/2677] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:41.812796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1345/2678] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:43.406037 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761078bc-962e-4001-a468-e51a8d94beeb service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:43.416358 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761078bc-962e-4001-a468-e51a8d94beeb service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:43.420646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee0808-c9b6-4f58-b790-68dc830eb9f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:43.421317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee0808-c9b6-4f58-b790-68dc830eb9f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:43.421602 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee0808-c9b6-4f58-b790-68dc830eb9f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:43.421878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee0808-c9b6-4f58-b790-68dc830eb9f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:43.481858 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee0808-c9b6-4f58-b790-68dc830eb9f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:43.483570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee0808-c9b6-4f58-b790-68dc830eb9f4 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:43.495131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1334/2679] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:44.039519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4837f3-ad28-463a-8077-65802c264758 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:44.049248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4837f3-ad28-463a-8077-65802c264758 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:44.053763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa7f50-edb3-4ed5-8932-53bfedfad7cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:44.054412 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa7f50-edb3-4ed5-8932-53bfedfad7cd service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:44.054697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa7f50-edb3-4ed5-8932-53bfedfad7cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:44.054953 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa7f50-edb3-4ed5-8932-53bfedfad7cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:44.065100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa7f50-edb3-4ed5-8932-53bfedfad7cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:44.067244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa7f50-edb3-4ed5-8932-53bfedfad7cd service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:44.078078 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1346/2680] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:44.430526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee0808-c9b6-4f58-b790-68dc830eb9f4 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:44.440098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee0808-c9b6-4f58-b790-68dc830eb9f4 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:44.444614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4608a-09f8-4446-b8c1-68b27a682b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:44.445300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4608a-09f8-4446-b8c1-68b27a682b4d service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:44.445611 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4608a-09f8-4446-b8c1-68b27a682b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:44.445859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4608a-09f8-4446-b8c1-68b27a682b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:44.456012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4608a-09f8-4446-b8c1-68b27a682b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:44.457487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4608a-09f8-4446-b8c1-68b27a682b4d service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:44.467469 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1335/2681] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:47.984554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa7f50-edb3-4ed5-8932-53bfedfad7cd service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:48.054673 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa7f50-edb3-4ed5-8932-53bfedfad7cd service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:48.059972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:48.060897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.061161 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.061437 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] PATH_INFO: `/v3/users/eb458f9a35c948cdabbcad6129f84496` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.062747 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb458f9a35c948cdabbcad6129f84496)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:48.064708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:48.118167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb458f9a35c948cdabbcad6129f84496'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.127941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb458f9a35c948cdabbcad6129f84496'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.128907 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb458f9a35c948cdabbcad6129f84496'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.130594 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:48.141113 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb458f9a35c948cdabbcad6129f84496'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.141822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb458f9a35c948cdabbcad6129f84496'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.167372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1347/2682] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:47 2022] DELETE /identity/v3/users/eb458f9a35c948cdabbcad6129f84496 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:48.174202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54027b6c-701b-4c14-803d-ce46b8efb219 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.174985 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54027b6c-701b-4c14-803d-ce46b8efb219 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.175096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54027b6c-701b-4c14-803d-ce46b8efb219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.195842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-54027b6c-701b-4c14-803d-ce46b8efb219 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:48.197312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-54027b6c-701b-4c14-803d-ce46b8efb219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:48.260706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1336/2683] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:48.274357 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:48.276392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:48.339031 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc50505-11e4-4ae4-886a-8ccd311fe49e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:48.343978 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2c181-b376-4327-abdf-4ab2a8234844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:48.344850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2c181-b376-4327-abdf-4ab2a8234844 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.345289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2c181-b376-4327-abdf-4ab2a8234844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.345575 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2c181-b376-4327-abdf-4ab2a8234844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.355481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2c181-b376-4327-abdf-4ab2a8234844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:48.356957 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2c181-b376-4327-abdf-4ab2a8234844 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:48.369279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1348/2684] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:48.668183 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54027b6c-701b-4c14-803d-ce46b8efb219 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:48.669812 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-54027b6c-701b-4c14-803d-ce46b8efb219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:48.683666 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54027b6c-701b-4c14-803d-ce46b8efb219 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:48.689233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:48.690133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.690381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.690655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] PATH_INFO: `/v3/projects/78e5b138487d487b9f6acfb7851204c1` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.692108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e5b138487d487b9f6acfb7851204c1)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:48.694126 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:48.712266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:48.744640 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e5b138487d487b9f6acfb7851204c1', 'request_id': 'req-2bde9bec-c5ad-4bf0-b730-3db645cd8683'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.754265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e5b138487d487b9f6acfb7851204c1', 'request_id': 'req-2bde9bec-c5ad-4bf0-b730-3db645cd8683'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.760635 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e5b138487d487b9f6acfb7851204c1', 'request_id': 'req-2bde9bec-c5ad-4bf0-b730-3db645cd8683'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.771488 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] The token cache is being invalidate because project 78e5b138487d487b9f6acfb7851204c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:48.771680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.772384 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.774002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1337/2685] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:48 2022] DELETE /identity/v3/projects/78e5b138487d487b9f6acfb7851204c1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:48.778391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2c181-b376-4327-abdf-4ab2a8234844 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:48.788642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2c181-b376-4327-abdf-4ab2a8234844 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:48.850804 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:48.851697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.851977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.852247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] PATH_INFO: `/v3/users/72be272d056442a8a958a67f20893495` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.853993 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=72be272d056442a8a958a67f20893495)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:48.855926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:48.905580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72be272d056442a8a958a67f20893495'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.913851 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72be272d056442a8a958a67f20893495'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.914505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72be272d056442a8a958a67f20893495'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.922040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72be272d056442a8a958a67f20893495'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.922685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72be272d056442a8a958a67f20893495'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:48.934554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:48.942853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1349/2686] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:48 2022] DELETE /identity/v3/users/72be272d056442a8a958a67f20893495 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:49.225010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:49.227178 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:49.243568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde9bec-c5ad-4bf0-b730-3db645cd8683 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:49.308628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:49.309484 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:49.309769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:49.310048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] PATH_INFO: `/v3/projects/4c480a37d4514da6bdcffbe1845bb619` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:49.311248 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c480a37d4514da6bdcffbe1845bb619)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:49.313225 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:49.363120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c480a37d4514da6bdcffbe1845bb619', 'request_id': 'req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:49.381493 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c480a37d4514da6bdcffbe1845bb619', 'request_id': 'req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:49.390901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c480a37d4514da6bdcffbe1845bb619', 'request_id': 'req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:49.403671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] The token cache is being invalidate because project 4c480a37d4514da6bdcffbe1845bb619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:49.403962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:49.404614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:49.406234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1338/2687] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:49 2022] DELETE /identity/v3/projects/4c480a37d4514da6bdcffbe1845bb619 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:49.410375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:49.412296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:49.425518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adda0ec-2424-4ca4-992c-8e8582c5e47d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:49.490777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:49.491683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:49.491933 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:49.492228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] PATH_INFO: `/v3/users/ab03dbabe6ff406c8d52fd665ee959d2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:49.493491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab03dbabe6ff406c8d52fd665ee959d2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:49.495482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:49.562302 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab03dbabe6ff406c8d52fd665ee959d2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:49.572429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab03dbabe6ff406c8d52fd665ee959d2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:49.573224 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab03dbabe6ff406c8d52fd665ee959d2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:49.580951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab03dbabe6ff406c8d52fd665ee959d2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:49.593072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d603100c-16f2-4967-bc6b-296ceb54fe64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab03dbabe6ff406c8d52fd665ee959d2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:49.614904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1350/2688] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:49 2022] DELETE /identity/v3/users/ab03dbabe6ff406c8d52fd665ee959d2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:49.934395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:49.936150 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:49.957285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf93748-bb2e-4412-9fa9-e91681b8e6c5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.000884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:50.032684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.033584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.033869 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.034147 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] PATH_INFO: `/v3/projects/1173591e51aa4bbdaa7166f1e1830912` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.035347 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1173591e51aa4bbdaa7166f1e1830912)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.037388 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.090557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1173591e51aa4bbdaa7166f1e1830912', 'request_id': 'req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:50.098918 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1173591e51aa4bbdaa7166f1e1830912', 'request_id': 'req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:50.107908 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1173591e51aa4bbdaa7166f1e1830912', 'request_id': 'req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:50.123792 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] The token cache is being invalidate because project 1173591e51aa4bbdaa7166f1e1830912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:50.124101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:50.124844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3aeec6df-9df5-4ed2-a272-53ac6bcf371f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:50.126405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1339/2689] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:49 2022] DELETE /identity/v3/projects/1173591e51aa4bbdaa7166f1e1830912 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:50.131712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aa79a-33f5-4f09-9099-4333d785d002 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.131999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aa79a-33f5-4f09-9099-4333d785d002 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.132302 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aa79a-33f5-4f09-9099-4333d785d002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.153242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e81aa79a-33f5-4f09-9099-4333d785d002 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:50.154449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e81aa79a-33f5-4f09-9099-4333d785d002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:50.219538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1351/2690] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:50.227167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddb1fc-0162-4121-96e9-e4e6a7523d10 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.227661 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddb1fc-0162-4121-96e9-e4e6a7523d10 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.227771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddb1fc-0162-4121-96e9-e4e6a7523d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.246556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-92ddb1fc-0162-4121-96e9-e4e6a7523d10 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:50.247756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-92ddb1fc-0162-4121-96e9-e4e6a7523d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:50.255921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1340/2691] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:50.260486 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aa79a-33f5-4f09-9099-4333d785d002 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.271072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aa79a-33f5-4f09-9099-4333d785d002 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.276319 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ea44-67cd-4547-aaac-b9c5eb864d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.277515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ea44-67cd-4547-aaac-b9c5eb864d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.278019 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ea44-67cd-4547-aaac-b9c5eb864d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.278509 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ea44-67cd-4547-aaac-b9c5eb864d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.279736 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ea44-67cd-4547-aaac-b9c5eb864d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:50.280233 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ea44-67cd-4547-aaac-b9c5eb864d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.282571 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ea44-67cd-4547-aaac-b9c5eb864d0c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.298455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:50.303338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1352/2692] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:50.308952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddb1fc-0162-4121-96e9-e4e6a7523d10 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.318610 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddb1fc-0162-4121-96e9-e4e6a7523d10 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.323767 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c08fd-e472-4067-bc2d-59d9b2a7d3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.324414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c08fd-e472-4067-bc2d-59d9b2a7d3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.324706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c08fd-e472-4067-bc2d-59d9b2a7d3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.324994 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c08fd-e472-4067-bc2d-59d9b2a7d3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.325683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c08fd-e472-4067-bc2d-59d9b2a7d3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.327572 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c08fd-e472-4067-bc2d-59d9b2a7d3a3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.354775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1341/2693] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:50 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:50.359050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ea44-67cd-4547-aaac-b9c5eb864d0c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.369925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ea44-67cd-4547-aaac-b9c5eb864d0c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.427519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b833b6d-cbc0-4956-8463-9297f8722195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.428205 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833b6d-cbc0-4956-8463-9297f8722195 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.428456 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833b6d-cbc0-4956-8463-9297f8722195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.428759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833b6d-cbc0-4956-8463-9297f8722195 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.429451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b833b6d-cbc0-4956-8463-9297f8722195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.431527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b833b6d-cbc0-4956-8463-9297f8722195 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.455609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1353/2694] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:50 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:50.459936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c08fd-e472-4067-bc2d-59d9b2a7d3a3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.470668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c08fd-e472-4067-bc2d-59d9b2a7d3a3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.475921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2c1e1-69f6-4c67-a908-a3b7b204bd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.476603 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2c1e1-69f6-4c67-a908-a3b7b204bd18 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.476899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2c1e1-69f6-4c67-a908-a3b7b204bd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.477171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2c1e1-69f6-4c67-a908-a3b7b204bd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.477902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2c1e1-69f6-4c67-a908-a3b7b204bd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.479736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2c1e1-69f6-4c67-a908-a3b7b204bd18 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.490583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1342/2695] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:25:50.494966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b833b6d-cbc0-4956-8463-9297f8722195 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.505333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b833b6d-cbc0-4956-8463-9297f8722195 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.510291 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464b835-882e-480d-b943-3897675f3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.510982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b835-882e-480d-b943-3897675f3ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.511268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b835-882e-480d-b943-3897675f3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.511540 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464b835-882e-480d-b943-3897675f3ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.512263 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464b835-882e-480d-b943-3897675f3ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.513898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464b835-882e-480d-b943-3897675f3ee1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.526980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1354/2696] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:50.531185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2c1e1-69f6-4c67-a908-a3b7b204bd18 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.541588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2c1e1-69f6-4c67-a908-a3b7b204bd18 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.547517 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fabd8-6005-4243-9ace-afd325abc1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.548404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fabd8-6005-4243-9ace-afd325abc1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.548693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fabd8-6005-4243-9ace-afd325abc1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.548998 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fabd8-6005-4243-9ace-afd325abc1b3 admin admin] PATH_INFO: `/v3/projects/919bd1a2483040a188441675c3c3f395/users/8133160b85ab4a3c9c5f0acdaba28bcb/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.564778 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fabd8-6005-4243-9ace-afd325abc1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919bd1a2483040a188441675c3c3f395, user_id=8133160b85ab4a3c9c5f0acdaba28bcb, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.567503 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fabd8-6005-4243-9ace-afd325abc1b3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.582724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1343/2697] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:50 2022] PUT /identity/v3/projects/919bd1a2483040a188441675c3c3f395/users/8133160b85ab4a3c9c5f0acdaba28bcb/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:50.593093 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd942e-7c9d-4a13-a72a-034b5cc9bbe0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.593373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd942e-7c9d-4a13-a72a-034b5cc9bbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.593744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd942e-7c9d-4a13-a72a-034b5cc9bbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.619666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-57cd942e-7c9d-4a13-a72a-034b5cc9bbe0 None None] MFA Rules not processed for user `8133160b85ab4a3c9c5f0acdaba28bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:50.620842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-57cd942e-7c9d-4a13-a72a-034b5cc9bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:50.683910 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1355/2698] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:50.695775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fabd8-6005-4243-9ace-afd325abc1b3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.698278 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-802fabd8-6005-4243-9ace-afd325abc1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:50.757502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fabd8-6005-4243-9ace-afd325abc1b3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.761829 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce296d-e3f6-4ceb-8b93-83e7fe5f09ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.762471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce296d-e3f6-4ceb-8b93-83e7fe5f09ab service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.762759 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce296d-e3f6-4ceb-8b93-83e7fe5f09ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.763022 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce296d-e3f6-4ceb-8b93-83e7fe5f09ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.771896 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce296d-e3f6-4ceb-8b93-83e7fe5f09ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.773354 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce296d-e3f6-4ceb-8b93-83e7fe5f09ab service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.782397 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1344/2699] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:56.613715 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd942e-7c9d-4a13-a72a-034b5cc9bbe0 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:56.615745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-57cd942e-7c9d-4a13-a72a-034b5cc9bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:56.676336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd942e-7c9d-4a13-a72a-034b5cc9bbe0 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:56.680157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f41b89-ad71-4485-8916-a780d4e12e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:56.680916 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f41b89-ad71-4485-8916-a780d4e12e99 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:56.681266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f41b89-ad71-4485-8916-a780d4e12e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:56.681614 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f41b89-ad71-4485-8916-a780d4e12e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:56.683548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-63f41b89-ad71-4485-8916-a780d4e12e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:56.707195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:56.753667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f41b89-ad71-4485-8916-a780d4e12e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:56.755135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f41b89-ad71-4485-8916-a780d4e12e99 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:56.767020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1356/2700] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:57.217582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce296d-e3f6-4ceb-8b93-83e7fe5f09ab service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:57.219167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-23ce296d-e3f6-4ceb-8b93-83e7fe5f09ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:57.228085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:57.235439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce296d-e3f6-4ceb-8b93-83e7fe5f09ab service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:57.242577 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:57.243585 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.244310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.244696 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] PATH_INFO: `/v3/users/7c6eec6ce40c46fca50f09549b8608a2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.246552 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6eec6ce40c46fca50f09549b8608a2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:57.248570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:57.326461 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6eec6ce40c46fca50f09549b8608a2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:57.327339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6eec6ce40c46fca50f09549b8608a2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:57.337249 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6eec6ce40c46fca50f09549b8608a2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:57.346114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6eec6ce40c46fca50f09549b8608a2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:57.346988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6eec6ce40c46fca50f09549b8608a2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:57.375343 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1345/2701] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:57 2022] DELETE /identity/v3/users/7c6eec6ce40c46fca50f09549b8608a2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:57.386646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd6e4-f54c-4605-ad2e-8c1f1eb32691 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.386646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd6e4-f54c-4605-ad2e-8c1f1eb32691 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.386646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd6e4-f54c-4605-ad2e-8c1f1eb32691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.405590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-14bcd6e4-f54c-4605-ad2e-8c1f1eb32691 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:57.406813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-14bcd6e4-f54c-4605-ad2e-8c1f1eb32691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:57.483596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1357/2702] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:57.493808 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:57.496527 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:57.563233 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eecee-4f98-42c0-8069-a2f243b5fe57 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:57.567305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763fbe3-6e71-41a1-bf5e-a8d86e5c2944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:57.568049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763fbe3-6e71-41a1-bf5e-a8d86e5c2944 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.568396 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763fbe3-6e71-41a1-bf5e-a8d86e5c2944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.568687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763fbe3-6e71-41a1-bf5e-a8d86e5c2944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.579674 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763fbe3-6e71-41a1-bf5e-a8d86e5c2944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:57.581621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763fbe3-6e71-41a1-bf5e-a8d86e5c2944 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:57.591779 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1346/2703] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:25:57.869573 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcd6e4-f54c-4605-ad2e-8c1f1eb32691 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:57.871309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-14bcd6e4-f54c-4605-ad2e-8c1f1eb32691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:57.889634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcd6e4-f54c-4605-ad2e-8c1f1eb32691 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:57.895612 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:57.896527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.896895 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.897655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] PATH_INFO: `/v3/projects/22f21c60c4264fdcabc0a378be9b7920` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.899300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f21c60c4264fdcabc0a378be9b7920)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:57.902722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:57.955377 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f21c60c4264fdcabc0a378be9b7920', 'request_id': 'req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:57.961391 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f21c60c4264fdcabc0a378be9b7920', 'request_id': 'req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:57.972374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f21c60c4264fdcabc0a378be9b7920', 'request_id': 'req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:57.984841 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] The token cache is being invalidate because project 22f21c60c4264fdcabc0a378be9b7920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:57.985129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:57.986167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:57.988012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1358/2704] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:57 2022] DELETE /identity/v3/projects/22f21c60c4264fdcabc0a378be9b7920 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:57.992084 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763fbe3-6e71-41a1-bf5e-a8d86e5c2944 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:58.003919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763fbe3-6e71-41a1-bf5e-a8d86e5c2944 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:58.072874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:58.074055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.074405 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.074743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] PATH_INFO: `/v3/users/ba1bbf958f2a42b29dffcb057fc02ec4` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.076076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1bbf958f2a42b29dffcb057fc02ec4)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:58.078110 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:58.105116 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:58.144255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1bbf958f2a42b29dffcb057fc02ec4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:58.144931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1bbf958f2a42b29dffcb057fc02ec4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:58.154422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1bbf958f2a42b29dffcb057fc02ec4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:58.162322 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1bbf958f2a42b29dffcb057fc02ec4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:58.163020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6c581d2a-ff58-46b9-bd05-ca2097e41389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1bbf958f2a42b29dffcb057fc02ec4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:58.182414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1347/2705] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:25:57 2022] DELETE /identity/v3/users/ba1bbf958f2a42b29dffcb057fc02ec4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:58.549977 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:58.551768 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:58.565968 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34168bf9-c4e7-4094-a2e8-d8b92ce672d2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:58.615481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:58.645485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:58.646367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.646663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.646935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] PATH_INFO: `/v3/projects/a6b9718c0a7549539111ba7f7d60bdf0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.648434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b9718c0a7549539111ba7f7d60bdf0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:58.651079 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:58.736964 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b9718c0a7549539111ba7f7d60bdf0', 'request_id': 'req-def73c5f-4c20-454d-96c0-6df4481bf7c1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:58.743778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b9718c0a7549539111ba7f7d60bdf0', 'request_id': 'req-def73c5f-4c20-454d-96c0-6df4481bf7c1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:58.754668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b9718c0a7549539111ba7f7d60bdf0', 'request_id': 'req-def73c5f-4c20-454d-96c0-6df4481bf7c1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:58.770241 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] The token cache is being invalidate because project a6b9718c0a7549539111ba7f7d60bdf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:25:58.770725 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:58.771563 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def73c5f-4c20-454d-96c0-6df4481bf7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:25:58.773280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1359/2706] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:25:58 2022] DELETE /identity/v3/projects/a6b9718c0a7549539111ba7f7d60bdf0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:58.778840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d3045-e72a-45b6-a830-8a9a0f6a7cd4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.779707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d3045-e72a-45b6-a830-8a9a0f6a7cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.780205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d3045-e72a-45b6-a830-8a9a0f6a7cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.801159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4b1d3045-e72a-45b6-a830-8a9a0f6a7cd4 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:58.802678 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4b1d3045-e72a-45b6-a830-8a9a0f6a7cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:58.881243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1348/2707] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:58.890687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505fc27-9dba-4a9b-be4c-504f9ecaa947 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.891609 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505fc27-9dba-4a9b-be4c-504f9ecaa947 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.892056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505fc27-9dba-4a9b-be4c-504f9ecaa947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.913221 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2505fc27-9dba-4a9b-be4c-504f9ecaa947 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:58.914457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2505fc27-9dba-4a9b-be4c-504f9ecaa947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:58.924883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1360/2708] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:25:58.929005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d3045-e72a-45b6-a830-8a9a0f6a7cd4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:58.941879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d3045-e72a-45b6-a830-8a9a0f6a7cd4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:58.948648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc441a7-2313-47cc-bf0e-6104ba7f8605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:58.949368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc441a7-2313-47cc-bf0e-6104ba7f8605 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.949771 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc441a7-2313-47cc-bf0e-6104ba7f8605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.950049 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc441a7-2313-47cc-bf0e-6104ba7f8605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.950784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc441a7-2313-47cc-bf0e-6104ba7f8605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:58.951085 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc441a7-2313-47cc-bf0e-6104ba7f8605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:58.952736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc441a7-2313-47cc-bf0e-6104ba7f8605 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:58.965689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1349/2709] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:58.969764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505fc27-9dba-4a9b-be4c-504f9ecaa947 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:58.981560 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505fc27-9dba-4a9b-be4c-504f9ecaa947 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:58.987301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cadbd-62c7-44d4-af68-febd85777544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:58.988495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cadbd-62c7-44d4-af68-febd85777544 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.988495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cadbd-62c7-44d4-af68-febd85777544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.988797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cadbd-62c7-44d4-af68-febd85777544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.989886 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cadbd-62c7-44d4-af68-febd85777544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:58.992410 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cadbd-62c7-44d4-af68-febd85777544 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.027797 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1361/2710] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:25:58 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:59.031744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc441a7-2313-47cc-bf0e-6104ba7f8605 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.043946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc441a7-2313-47cc-bf0e-6104ba7f8605 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.105099 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5da25-3cc0-4b02-b9c5-0da219e6efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.105775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5da25-3cc0-4b02-b9c5-0da219e6efaa admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.106054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5da25-3cc0-4b02-b9c5-0da219e6efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.106942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5da25-3cc0-4b02-b9c5-0da219e6efaa admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.107103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5da25-3cc0-4b02-b9c5-0da219e6efaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.108960 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5da25-3cc0-4b02-b9c5-0da219e6efaa admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.143886 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1350/2711] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:25:59 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:59.148190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cadbd-62c7-44d4-af68-febd85777544 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.159422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cadbd-62c7-44d4-af68-febd85777544 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.165379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cf416-46d7-43d4-a530-f702a3cef27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.166167 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cf416-46d7-43d4-a530-f702a3cef27e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.166558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cf416-46d7-43d4-a530-f702a3cef27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.166839 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cf416-46d7-43d4-a530-f702a3cef27e admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.167606 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cf416-46d7-43d4-a530-f702a3cef27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.169299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cf416-46d7-43d4-a530-f702a3cef27e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.180570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1362/2712] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:59.184840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5da25-3cc0-4b02-b9c5-0da219e6efaa admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.195125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5da25-3cc0-4b02-b9c5-0da219e6efaa admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.199817 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a95d8-e531-49c0-a937-64b9eb9fe3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.200479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a95d8-e531-49c0-a937-64b9eb9fe3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.200798 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a95d8-e531-49c0-a937-64b9eb9fe3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.201072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a95d8-e531-49c0-a937-64b9eb9fe3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.201872 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a95d8-e531-49c0-a937-64b9eb9fe3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.203639 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a95d8-e531-49c0-a937-64b9eb9fe3a7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.214420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1351/2713] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:59.218658 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cf416-46d7-43d4-a530-f702a3cef27e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.230685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cf416-46d7-43d4-a530-f702a3cef27e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.235328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960fddd-e97e-4369-85be-a56d99339069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.236239 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960fddd-e97e-4369-85be-a56d99339069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.236517 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960fddd-e97e-4369-85be-a56d99339069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.236817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960fddd-e97e-4369-85be-a56d99339069 admin admin] PATH_INFO: `/v3/projects/a72ec7b9e86245a79e8ccb29a9fd9ce9/users/41dad262dbba4f62ab74ad331195c760/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.254157 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960fddd-e97e-4369-85be-a56d99339069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72ec7b9e86245a79e8ccb29a9fd9ce9, user_id=41dad262dbba4f62ab74ad331195c760, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.256888 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960fddd-e97e-4369-85be-a56d99339069 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.272119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1363/2714] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:25:59 2022] PUT /identity/v3/projects/a72ec7b9e86245a79e8ccb29a9fd9ce9/users/41dad262dbba4f62ab74ad331195c760/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:59.278034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98296044-c918-4f03-bd8d-dee2441bda2d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.278318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98296044-c918-4f03-bd8d-dee2441bda2d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.278641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98296044-c918-4f03-bd8d-dee2441bda2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.285856 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:59.304867 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-98296044-c918-4f03-bd8d-dee2441bda2d None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:59.307837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-98296044-c918-4f03-bd8d-dee2441bda2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:59.379376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1352/2715] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:25:59.389720 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960fddd-e97e-4369-85be-a56d99339069 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.391524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3960fddd-e97e-4369-85be-a56d99339069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:59.459217 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960fddd-e97e-4369-85be-a56d99339069 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.463176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1f6f-bf16-4836-be4a-970f5927e66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.463920 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1f6f-bf16-4836-be4a-970f5927e66b service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.464212 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1f6f-bf16-4836-be4a-970f5927e66b service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.464478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1f6f-bf16-4836-be4a-970f5927e66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.474880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c1f6f-bf16-4836-be4a-970f5927e66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.476328 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c1f6f-bf16-4836-be4a-970f5927e66b service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.487562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1364/2716] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:00.401882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b519eac-5b60-493f-9d37-faf1bd93b937 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.402375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b519eac-5b60-493f-9d37-faf1bd93b937 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.402497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b519eac-5b60-493f-9d37-faf1bd93b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.404135 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1f6f-bf16-4836-be4a-970f5927e66b service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.406086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e58c1f6f-bf16-4836-be4a-970f5927e66b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:00.425416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:00.442137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2b519eac-5b60-493f-9d37-faf1bd93b937 None None] MFA Rules not processed for user `41dad262dbba4f62ab74ad331195c760`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:00.444092 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2b519eac-5b60-493f-9d37-faf1bd93b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:00.533972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1f6f-bf16-4836-be4a-970f5927e66b service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.539470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24179f5-b88d-4b5d-9689-bad0cec58b18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.540176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24179f5-b88d-4b5d-9689-bad0cec58b18 service placement] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.540458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24179f5-b88d-4b5d-9689-bad0cec58b18 service placement] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.541013 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24179f5-b88d-4b5d-9689-bad0cec58b18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.543179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e24179f5-b88d-4b5d-9689-bad0cec58b18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:00.553860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1353/2717] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:00.554838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b519eac-5b60-493f-9d37-faf1bd93b937 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.556118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2b519eac-5b60-493f-9d37-faf1bd93b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:00.558807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24179f5-b88d-4b5d-9689-bad0cec58b18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.560923 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24179f5-b88d-4b5d-9689-bad0cec58b18 service placement] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.572520 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1365/2718] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:00.573422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24179f5-b88d-4b5d-9689-bad0cec58b18 service placement] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.577687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b519eac-5b60-493f-9d37-faf1bd93b937 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.583128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.584007 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24179f5-b88d-4b5d-9689-bad0cec58b18 service placement] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.584238 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.584684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.585005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] PATH_INFO: `/v3/users/090b5fdbe72e403db95a2e8dacbef7e5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.587036 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090b5fdbe72e403db95a2e8dacbef7e5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.589277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.592778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbeade-cb12-41e3-8934-e84e7b3d0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.593460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbeade-cb12-41e3-8934-e84e7b3d0e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.594362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbeade-cb12-41e3-8934-e84e7b3d0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.594362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbeade-cb12-41e3-8934-e84e7b3d0e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.594701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbeade-cb12-41e3-8934-e84e7b3d0e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.596601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbeade-cb12-41e3-8934-e84e7b3d0e49 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.633575 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1366/2719] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:00 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:00.637503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbeade-cb12-41e3-8934-e84e7b3d0e49 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.664453 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090b5fdbe72e403db95a2e8dacbef7e5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:00.665270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090b5fdbe72e403db95a2e8dacbef7e5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:00.676218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090b5fdbe72e403db95a2e8dacbef7e5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:00.685104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090b5fdbe72e403db95a2e8dacbef7e5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:00.685882 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090b5fdbe72e403db95a2e8dacbef7e5'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:00.706887 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1354/2720] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:00 2022] DELETE /identity/v3/users/090b5fdbe72e403db95a2e8dacbef7e5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:00.715017 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbeade-cb12-41e3-8934-e84e7b3d0e49 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.779057 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f5add-3eb5-4049-b8fa-c2af3172f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.779765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5add-3eb5-4049-b8fa-c2af3172f9ec admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.780049 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5add-3eb5-4049-b8fa-c2af3172f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.780326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5add-3eb5-4049-b8fa-c2af3172f9ec admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.781075 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f5add-3eb5-4049-b8fa-c2af3172f9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.783046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f5add-3eb5-4049-b8fa-c2af3172f9ec admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.805623 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1367/2721] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:00 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:00.809708 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.811165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:00.820857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:00.825217 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c6e7-3978-439a-afb6-54e8d79e22f3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.832327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ad6ae-93c6-4c12-a804-cdb29e099f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.833204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad6ae-93c6-4c12-a804-cdb29e099f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.833492 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad6ae-93c6-4c12-a804-cdb29e099f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.833842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad6ae-93c6-4c12-a804-cdb29e099f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.834526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ad6ae-93c6-4c12-a804-cdb29e099f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.836464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ad6ae-93c6-4c12-a804-cdb29e099f6c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.852766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1355/2722] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:26:00.854554 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f5add-3eb5-4049-b8fa-c2af3172f9ec admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.867232 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f5add-3eb5-4049-b8fa-c2af3172f9ec admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.872123 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6f1d1-61eb-4008-99f5-38052ab997fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.873219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6f1d1-61eb-4008-99f5-38052ab997fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.873562 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6f1d1-61eb-4008-99f5-38052ab997fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.873844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6f1d1-61eb-4008-99f5-38052ab997fd admin admin] PATH_INFO: `/v3/projects/0b5df002f1ff4169ae7574e61935aa85/users/a81c4602aaff4107a953848b4a082419/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.878569 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ad6ae-93c6-4c12-a804-cdb29e099f6c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.880420 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e86ad6ae-93c6-4c12-a804-cdb29e099f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:00.894987 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ad6ae-93c6-4c12-a804-cdb29e099f6c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.899757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:00.899998 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.901104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.901520 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.901909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] PATH_INFO: `/v3/users/8133160b85ab4a3c9c5f0acdaba28bcb` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.903444 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8133160b85ab4a3c9c5f0acdaba28bcb)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.905301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.908466 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6f1d1-61eb-4008-99f5-38052ab997fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5df002f1ff4169ae7574e61935aa85, user_id=a81c4602aaff4107a953848b4a082419, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.911668 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6f1d1-61eb-4008-99f5-38052ab997fd admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.934470 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1368/2723] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:00 2022] PUT /identity/v3/projects/0b5df002f1ff4169ae7574e61935aa85/users/a81c4602aaff4107a953848b4a082419/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:00.935430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6f1d1-61eb-4008-99f5-38052ab997fd admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.937443 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-87d6f1d1-61eb-4008-99f5-38052ab997fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:00.966724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8133160b85ab4a3c9c5f0acdaba28bcb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:00.967839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8133160b85ab4a3c9c5f0acdaba28bcb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:00.976900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8133160b85ab4a3c9c5f0acdaba28bcb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:00.984959 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8133160b85ab4a3c9c5f0acdaba28bcb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:00.985646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8133160b85ab4a3c9c5f0acdaba28bcb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:01.003578 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1356/2724] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:00 2022] DELETE /identity/v3/users/8133160b85ab4a3c9c5f0acdaba28bcb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:01.004176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6f1d1-61eb-4008-99f5-38052ab997fd admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.004879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.006310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:01.063757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.064636 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.064946 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.065223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] PATH_INFO: `/v3/projects/82bcb314827f4140b7012ec880d20e3a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.066505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=82bcb314827f4140b7012ec880d20e3a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.068453 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.074451 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d39e2f-0895-4c35-a1af-6f1e5ad6c3dc admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.079336 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ef748-09f0-47cd-8b63-4ba78edb5244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.080053 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ef748-09f0-47cd-8b63-4ba78edb5244 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.080340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ef748-09f0-47cd-8b63-4ba78edb5244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.080646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ef748-09f0-47cd-8b63-4ba78edb5244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.081447 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ef748-09f0-47cd-8b63-4ba78edb5244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.083066 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ef748-09f0-47cd-8b63-4ba78edb5244 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.093450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1357/2725] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:01.098180 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2489d9-c3be-4e58-ba67-fdf647456049 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.098472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2489d9-c3be-4e58-ba67-fdf647456049 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.098756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2489d9-c3be-4e58-ba67-fdf647456049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.117502 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-de2489d9-c3be-4e58-ba67-fdf647456049 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:01.117744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82bcb314827f4140b7012ec880d20e3a', 'request_id': 'req-b0241196-078b-4a60-bdf7-ab12cf3742aa'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:01.118732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-de2489d9-c3be-4e58-ba67-fdf647456049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:01.123419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82bcb314827f4140b7012ec880d20e3a', 'request_id': 'req-b0241196-078b-4a60-bdf7-ab12cf3742aa'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:01.131552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82bcb314827f4140b7012ec880d20e3a', 'request_id': 'req-b0241196-078b-4a60-bdf7-ab12cf3742aa'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:01.146467 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] The token cache is being invalidate because project 82bcb314827f4140b7012ec880d20e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:01.146689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:01.147465 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:01.149290 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1369/2726] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:00 2022] DELETE /identity/v3/projects/82bcb314827f4140b7012ec880d20e3a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:01.149901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.151897 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:01.186097 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:01.187160 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1358/2727] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:01.190295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cfc2e-66ee-4bf0-9d18-b7eda5fe0724 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.190295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cfc2e-66ee-4bf0-9d18-b7eda5fe0724 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.190295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cfc2e-66ee-4bf0-9d18-b7eda5fe0724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.196114 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:01.209074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-478cfc2e-66ee-4bf0-9d18-b7eda5fe0724 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:01.210881 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-478cfc2e-66ee-4bf0-9d18-b7eda5fe0724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:01.220097 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1359/2728] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:01.220945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cfc2e-66ee-4bf0-9d18-b7eda5fe0724 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.222271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-478cfc2e-66ee-4bf0-9d18-b7eda5fe0724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:01.231642 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241196-078b-4a60-bdf7-ab12cf3742aa admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.236407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe235a36-bf73-4779-8415-d29daf4ba434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.237421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235a36-bf73-4779-8415-d29daf4ba434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.237705 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235a36-bf73-4779-8415-d29daf4ba434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.237976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235a36-bf73-4779-8415-d29daf4ba434 admin admin] PATH_INFO: `/v3/projects/0b5df002f1ff4169ae7574e61935aa85/users/a81c4602aaff4107a953848b4a082419/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.239958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe235a36-bf73-4779-8415-d29daf4ba434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5df002f1ff4169ae7574e61935aa85, user_id=a81c4602aaff4107a953848b4a082419, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.242634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe235a36-bf73-4779-8415-d29daf4ba434 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.253590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1370/2729] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:01 2022] PUT /identity/v3/projects/0b5df002f1ff4169ae7574e61935aa85/users/a81c4602aaff4107a953848b4a082419/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:01.254932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b1d6-1a00-4475-943d-69954ca69566 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.255301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b1d6-1a00-4475-943d-69954ca69566 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.255638 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b1d6-1a00-4475-943d-69954ca69566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.275556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-71a3b1d6-1a00-4475-943d-69954ca69566 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:01.277140 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-71a3b1d6-1a00-4475-943d-69954ca69566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:01.295551 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cfc2e-66ee-4bf0-9d18-b7eda5fe0724 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.353174 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1371/2730] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:01.353424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c345b-463a-4ec0-bb59-1dd761cfd398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.353971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c345b-463a-4ec0-bb59-1dd761cfd398 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.354320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c345b-463a-4ec0-bb59-1dd761cfd398 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.354926 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c345b-463a-4ec0-bb59-1dd761cfd398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.359545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3b1d6-1a00-4475-943d-69954ca69566 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.370105 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c345b-463a-4ec0-bb59-1dd761cfd398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.371794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c345b-463a-4ec0-bb59-1dd761cfd398 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.382647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3b1d6-1a00-4475-943d-69954ca69566 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.385974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1360/2731] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:01.390045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10040b5-e938-4c7b-b5ae-a753a7e95223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.391036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10040b5-e938-4c7b-b5ae-a753a7e95223 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.391468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10040b5-e938-4c7b-b5ae-a753a7e95223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.391847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10040b5-e938-4c7b-b5ae-a753a7e95223 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.393028 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10040b5-e938-4c7b-b5ae-a753a7e95223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:01.393501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10040b5-e938-4c7b-b5ae-a753a7e95223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.396053 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10040b5-e938-4c7b-b5ae-a753a7e95223 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.413723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1372/2732] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:01.419694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c345b-463a-4ec0-bb59-1dd761cfd398 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.430061 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c345b-463a-4ec0-bb59-1dd761cfd398 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.435904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fd37e-fa43-40a4-967a-883ac9f5af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.436579 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fd37e-fa43-40a4-967a-883ac9f5af3c admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.436971 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fd37e-fa43-40a4-967a-883ac9f5af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.437243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fd37e-fa43-40a4-967a-883ac9f5af3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.437956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fd37e-fa43-40a4-967a-883ac9f5af3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.439862 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fd37e-fa43-40a4-967a-883ac9f5af3c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.467735 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1361/2733] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:01 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:01.472048 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10040b5-e938-4c7b-b5ae-a753a7e95223 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.484369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10040b5-e938-4c7b-b5ae-a753a7e95223 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.547724 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb454ba-d79f-463e-b479-195f95282f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.548418 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb454ba-d79f-463e-b479-195f95282f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.548829 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb454ba-d79f-463e-b479-195f95282f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.549116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb454ba-d79f-463e-b479-195f95282f40 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.549843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb454ba-d79f-463e-b479-195f95282f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.551794 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb454ba-d79f-463e-b479-195f95282f40 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.572102 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1373/2734] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:01 2022] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:01.576464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fd37e-fa43-40a4-967a-883ac9f5af3c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.587052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fd37e-fa43-40a4-967a-883ac9f5af3c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.595694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb8673-4a7e-4f4d-b97d-54af04127794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.596393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb8673-4a7e-4f4d-b97d-54af04127794 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.597382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb8673-4a7e-4f4d-b97d-54af04127794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.597382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb8673-4a7e-4f4d-b97d-54af04127794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.597839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb8673-4a7e-4f4d-b97d-54af04127794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.599547 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb8673-4a7e-4f4d-b97d-54af04127794 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.610860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1362/2735] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:01.615119 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb454ba-d79f-463e-b479-195f95282f40 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.626374 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb454ba-d79f-463e-b479-195f95282f40 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.631901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b7995-9f66-443f-92ce-c351364ad18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.632827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b7995-9f66-443f-92ce-c351364ad18e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.633179 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b7995-9f66-443f-92ce-c351364ad18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.633528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b7995-9f66-443f-92ce-c351364ad18e admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.634615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b7995-9f66-443f-92ce-c351364ad18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.636528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b7995-9f66-443f-92ce-c351364ad18e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.653215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1374/2736] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:01.654643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb8673-4a7e-4f4d-b97d-54af04127794 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.668004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb8673-4a7e-4f4d-b97d-54af04127794 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.673579 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0dd33-8fea-4040-83ca-d14c0bb6832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.674608 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0dd33-8fea-4040-83ca-d14c0bb6832c admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.674891 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0dd33-8fea-4040-83ca-d14c0bb6832c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.675687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0dd33-8fea-4040-83ca-d14c0bb6832c admin admin] PATH_INFO: `/v3/projects/937175cd50d445aca27ced74e03fd1c3/users/89fbe8917ebe49d8b85f1138c9d47ad7/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.692101 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0dd33-8fea-4040-83ca-d14c0bb6832c admin admin] RBAC: Authorizing `identity:create_grant(project_id=937175cd50d445aca27ced74e03fd1c3, user_id=89fbe8917ebe49d8b85f1138c9d47ad7, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.695306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0dd33-8fea-4040-83ca-d14c0bb6832c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.712197 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1363/2737] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:01 2022] PUT /identity/v3/projects/937175cd50d445aca27ced74e03fd1c3/users/89fbe8917ebe49d8b85f1138c9d47ad7/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:01.726848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb034-e693-49ce-86fd-b7179b4eabe9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.727356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb034-e693-49ce-86fd-b7179b4eabe9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.727634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb034-e693-49ce-86fd-b7179b4eabe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.763109 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ceddb034-e693-49ce-86fd-b7179b4eabe9 None None] MFA Rules not processed for user `89fbe8917ebe49d8b85f1138c9d47ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:01.764975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ceddb034-e693-49ce-86fd-b7179b4eabe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:01.784175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:01.838433 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1375/2738] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:26:01.843069 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0dd33-8fea-4040-83ca-d14c0bb6832c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.905643 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:01.909833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0dd33-8fea-4040-83ca-d14c0bb6832c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:01.915370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4776b-5e14-420c-bc4d-645800b8794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:01.916216 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4776b-5e14-420c-bc4d-645800b8794b admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:01.916847 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4776b-5e14-420c-bc4d-645800b8794b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:01.917129 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4776b-5e14-420c-bc4d-645800b8794b admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:01.917840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4776b-5e14-420c-bc4d-645800b8794b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:01.919840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4776b-5e14-420c-bc4d-645800b8794b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:01.952910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1364/2739] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:01 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:01.954309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddb034-e693-49ce-86fd-b7179b4eabe9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:01.966202 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddb034-e693-49ce-86fd-b7179b4eabe9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.037005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bd674-ec57-4384-a35b-5bfabd1c5c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.037785 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bd674-ec57-4384-a35b-5bfabd1c5c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.038162 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bd674-ec57-4384-a35b-5bfabd1c5c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.038550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bd674-ec57-4384-a35b-5bfabd1c5c1b admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.039355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bd674-ec57-4384-a35b-5bfabd1c5c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.039679 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4776b-5e14-420c-bc4d-645800b8794b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.041630 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bd674-ec57-4384-a35b-5bfabd1c5c1b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.042264 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-23e4776b-5e14-420c-bc4d-645800b8794b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.058279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4776b-5e14-420c-bc4d-645800b8794b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.063011 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.063984 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.064698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.064698 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] PATH_INFO: `/v3/projects/919bd1a2483040a188441675c3c3f395` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.065099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1376/2740] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:01 2022] POST /identity/v3/users => generated 308 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:02.068759 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bd674-ec57-4384-a35b-5bfabd1c5c1b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.074394 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=919bd1a2483040a188441675c3c3f395)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.076873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.081808 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bd674-ec57-4384-a35b-5bfabd1c5c1b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.088111 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f4d76-f555-46d2-a469-082237053b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.089110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f4d76-f555-46d2-a469-082237053b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.089400 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f4d76-f555-46d2-a469-082237053b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.089681 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f4d76-f555-46d2-a469-082237053b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.090559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f4d76-f555-46d2-a469-082237053b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.092463 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f4d76-f555-46d2-a469-082237053b4b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.108108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1377/2741] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:26:02.109289 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f4d76-f555-46d2-a469-082237053b4b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.121280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f4d76-f555-46d2-a469-082237053b4b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.126005 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23d15b-351d-4613-86b3-992139dc567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.126928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23d15b-351d-4613-86b3-992139dc567e admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.127209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23d15b-351d-4613-86b3-992139dc567e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.127595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23d15b-351d-4613-86b3-992139dc567e admin admin] PATH_INFO: `/v3/projects/d46728801353429bb46d9d28f973997d/users/6ac7715146124bef82708c283f017537/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.145386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23d15b-351d-4613-86b3-992139dc567e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46728801353429bb46d9d28f973997d, user_id=6ac7715146124bef82708c283f017537, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.148502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23d15b-351d-4613-86b3-992139dc567e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.152249 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919bd1a2483040a188441675c3c3f395', 'request_id': 'req-23763019-8033-42be-96cf-373eb328cb3b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:02.165087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919bd1a2483040a188441675c3c3f395', 'request_id': 'req-23763019-8033-42be-96cf-373eb328cb3b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:02.177428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919bd1a2483040a188441675c3c3f395', 'request_id': 'req-23763019-8033-42be-96cf-373eb328cb3b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:02.181870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1378/2742] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:02 2022] PUT /identity/v3/projects/d46728801353429bb46d9d28f973997d/users/6ac7715146124bef82708c283f017537/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:26:02.181870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a75a-ec7a-4d86-97da-243b37b15d78 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.181870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a75a-ec7a-4d86-97da-243b37b15d78 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.181870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5a75a-ec7a-4d86-97da-243b37b15d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.189830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] The token cache is being invalidate because project 919bd1a2483040a188441675c3c3f395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:02.190118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:02.190838 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:02.192591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1365/2743] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:02 2022] DELETE /identity/v3/projects/919bd1a2483040a188441675c3c3f395 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:26:02.196864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.198594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.211732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c6a5a75a-ec7a-4d86-97da-243b37b15d78 None None] MFA Rules not processed for user `a81c4602aaff4107a953848b4a082419`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:02.213365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c6a5a75a-ec7a-4d86-97da-243b37b15d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.268333 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763019-8033-42be-96cf-373eb328cb3b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.289561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:02.306941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1379/2744] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:02.306941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0cf09-263b-48da-b55b-f7be3ef80c61 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.306941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0cf09-263b-48da-b55b-f7be3ef80c61 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.306941 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0cf09-263b-48da-b55b-f7be3ef80c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.326902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e2b0cf09-263b-48da-b55b-f7be3ef80c61 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:02.327788 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e2b0cf09-263b-48da-b55b-f7be3ef80c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.335399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7b583-942f-4c30-a9fd-79c70023c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.336189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7b583-942f-4c30-a9fd-79c70023c16c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.336676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7b583-942f-4c30-a9fd-79c70023c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.337028 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7b583-942f-4c30-a9fd-79c70023c16c admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.337871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7b583-942f-4c30-a9fd-79c70023c16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.339827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7b583-942f-4c30-a9fd-79c70023c16c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.354107 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1366/2745] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:02.355638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c48f13-1e77-46cf-9988-c21480296dd6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.355930 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c48f13-1e77-46cf-9988-c21480296dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.356207 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c48f13-1e77-46cf-9988-c21480296dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.383202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-32c48f13-1e77-46cf-9988-c21480296dd6 None None] MFA Rules not processed for user `41dad262dbba4f62ab74ad331195c760`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:02.384448 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-32c48f13-1e77-46cf-9988-c21480296dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.388743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:02.404203 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1380/2746] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:02.405074 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0cf09-263b-48da-b55b-f7be3ef80c61 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.422741 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0cf09-263b-48da-b55b-f7be3ef80c61 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.427696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89ccd8-b8e7-483b-8389-0a2138aa3138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.428546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89ccd8-b8e7-483b-8389-0a2138aa3138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.429244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89ccd8-b8e7-483b-8389-0a2138aa3138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.429244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89ccd8-b8e7-483b-8389-0a2138aa3138 admin admin] PATH_INFO: `/v3/projects/d46728801353429bb46d9d28f973997d/users/6ac7715146124bef82708c283f017537/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.431112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89ccd8-b8e7-483b-8389-0a2138aa3138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46728801353429bb46d9d28f973997d, user_id=6ac7715146124bef82708c283f017537, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.434463 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89ccd8-b8e7-483b-8389-0a2138aa3138 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.445322 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1381/2747] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:02 2022] PUT /identity/v3/projects/d46728801353429bb46d9d28f973997d/users/6ac7715146124bef82708c283f017537/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:02.446001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1367/2748] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:02.446557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1983fe-ecc5-40ab-b7d0-222bf8687506 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.446847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1983fe-ecc5-40ab-b7d0-222bf8687506 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.447193 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1983fe-ecc5-40ab-b7d0-222bf8687506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.456590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fbc84-66e6-43ad-b1e8-c9cdfb7631c1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.456939 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fbc84-66e6-43ad-b1e8-c9cdfb7631c1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.457189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fbc84-66e6-43ad-b1e8-c9cdfb7631c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.465987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cf1983fe-ecc5-40ab-b7d0-222bf8687506 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:02.467228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cf1983fe-ecc5-40ab-b7d0-222bf8687506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.486934 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c21fbc84-66e6-43ad-b1e8-c9cdfb7631c1 None None] MFA Rules not processed for user `6ac7715146124bef82708c283f017537`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:02.488130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c21fbc84-66e6-43ad-b1e8-c9cdfb7631c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.529480 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1382/2749] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:02.530404 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1983fe-ecc5-40ab-b7d0-222bf8687506 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.531774 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cf1983fe-ecc5-40ab-b7d0-222bf8687506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.562553 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1368/2750] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:26:02.564082 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fbc84-66e6-43ad-b1e8-c9cdfb7631c1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.575693 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fbc84-66e6-43ad-b1e8-c9cdfb7631c1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.580567 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81ff24-b76b-4c45-a0e7-c265d3f34e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.581266 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ff24-b76b-4c45-a0e7-c265d3f34e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.581549 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ff24-b76b-4c45-a0e7-c265d3f34e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.581835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ff24-b76b-4c45-a0e7-c265d3f34e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.582599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81ff24-b76b-4c45-a0e7-c265d3f34e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:02.582905 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81ff24-b76b-4c45-a0e7-c265d3f34e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.584519 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81ff24-b76b-4c45-a0e7-c265d3f34e1a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.596835 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1369/2751] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:02.597840 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81ff24-b76b-4c45-a0e7-c265d3f34e1a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.603566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8b81ff24-b76b-4c45-a0e7-c265d3f34e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.614569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1983fe-ecc5-40ab-b7d0-222bf8687506 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.620602 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4783ae-24a2-4001-9dd3-e53117229c22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.621313 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4783ae-24a2-4001-9dd3-e53117229c22 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.621610 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4783ae-24a2-4001-9dd3-e53117229c22 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.621874 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4783ae-24a2-4001-9dd3-e53117229c22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.624430 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7c4783ae-24a2-4001-9dd3-e53117229c22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.648397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:02.661239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81ff24-b76b-4c45-a0e7-c265d3f34e1a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.664988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cfa20-af28-4236-bf5a-b58f07f72a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.665638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfa20-af28-4236-bf5a-b58f07f72a61 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.666131 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfa20-af28-4236-bf5a-b58f07f72a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.666416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfa20-af28-4236-bf5a-b58f07f72a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.675927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cfa20-af28-4236-bf5a-b58f07f72a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.677320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cfa20-af28-4236-bf5a-b58f07f72a61 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.687134 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1370/2752] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:02.687924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cfa20-af28-4236-bf5a-b58f07f72a61 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.688484 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4783ae-24a2-4001-9dd3-e53117229c22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.690275 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4783ae-24a2-4001-9dd3-e53117229c22 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.698392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cfa20-af28-4236-bf5a-b58f07f72a61 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.702040 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1383/2753] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:02.706494 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8188d-66ab-4876-9190-d15bae2242c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.707401 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8188d-66ab-4876-9190-d15bae2242c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.708239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8188d-66ab-4876-9190-d15bae2242c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.708239 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8188d-66ab-4876-9190-d15bae2242c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.709360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8188d-66ab-4876-9190-d15bae2242c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.710883 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8188d-66ab-4876-9190-d15bae2242c9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.743174 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1371/2754] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:02 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:02.748001 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4783ae-24a2-4001-9dd3-e53117229c22 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.759575 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4783ae-24a2-4001-9dd3-e53117229c22 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.830848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640209ae-6254-4136-97b7-2cd796e8793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.832191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640209ae-6254-4136-97b7-2cd796e8793b admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.832382 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640209ae-6254-4136-97b7-2cd796e8793b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.832698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640209ae-6254-4136-97b7-2cd796e8793b admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.833539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640209ae-6254-4136-97b7-2cd796e8793b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.836092 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640209ae-6254-4136-97b7-2cd796e8793b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.858883 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1384/2755] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:02 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:02.866109 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8188d-66ab-4876-9190-d15bae2242c9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.868421 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640209ae-6254-4136-97b7-2cd796e8793b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.877404 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8188d-66ab-4876-9190-d15bae2242c9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.878877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640209ae-6254-4136-97b7-2cd796e8793b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.882235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bb24f-e499-4651-bec1-2fb0a0139839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.882913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bb24f-e499-4651-bec1-2fb0a0139839 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.883259 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bb24f-e499-4651-bec1-2fb0a0139839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.883480 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bb24f-e499-4651-bec1-2fb0a0139839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.884220 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bb24f-e499-4651-bec1-2fb0a0139839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.884651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.885624 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.885965 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.886243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bb24f-e499-4651-bec1-2fb0a0139839 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.886359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] PATH_INFO: `/v3/users/89fbe8917ebe49d8b85f1138c9d47ad7` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.887748 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89fbe8917ebe49d8b85f1138c9d47ad7)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.888736 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:02.890375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.905452 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1372/2756] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:02.909491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bb24f-e499-4651-bec1-2fb0a0139839 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.925010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bb24f-e499-4651-bec1-2fb0a0139839 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.930885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff34f9-6a5b-4fbb-800c-b72a7eaa8517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.931768 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff34f9-6a5b-4fbb-800c-b72a7eaa8517 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.932102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff34f9-6a5b-4fbb-800c-b72a7eaa8517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.932383 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff34f9-6a5b-4fbb-800c-b72a7eaa8517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.933229 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff34f9-6a5b-4fbb-800c-b72a7eaa8517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.934863 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff34f9-6a5b-4fbb-800c-b72a7eaa8517 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.949132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1373/2757] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:26:02.949310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89fbe8917ebe49d8b85f1138c9d47ad7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:02.951307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff34f9-6a5b-4fbb-800c-b72a7eaa8517 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.959581 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89fbe8917ebe49d8b85f1138c9d47ad7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:02.960491 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89fbe8917ebe49d8b85f1138c9d47ad7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:02.962300 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff34f9-6a5b-4fbb-800c-b72a7eaa8517 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.967012 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55023c-dab6-4954-8d60-1e66668f8566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.967913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55023c-dab6-4954-8d60-1e66668f8566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.968032 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89fbe8917ebe49d8b85f1138c9d47ad7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:02.968374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55023c-dab6-4954-8d60-1e66668f8566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.968605 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55023c-dab6-4954-8d60-1e66668f8566 admin admin] PATH_INFO: `/v3/projects/9075f764f9e043db91466161a007a2b4/users/4899d5724cec43fb94a817ca8382a317/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.968817 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89fbe8917ebe49d8b85f1138c9d47ad7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:02.983976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55023c-dab6-4954-8d60-1e66668f8566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9075f764f9e043db91466161a007a2b4, user_id=4899d5724cec43fb94a817ca8382a317, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.986182 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1385/2758] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:02 2022] DELETE /identity/v3/users/89fbe8917ebe49d8b85f1138c9d47ad7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:26:02.986997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.988340 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.989582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55023c-dab6-4954-8d60-1e66668f8566 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:03.003062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1374/2759] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:02 2022] PUT /identity/v3/projects/9075f764f9e043db91466161a007a2b4/users/4899d5724cec43fb94a817ca8382a317/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:03.004335 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42894d-df4c-4719-912b-81ee312a9079 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:03.004621 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42894d-df4c-4719-912b-81ee312a9079 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:03.005003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42894d-df4c-4719-912b-81ee312a9079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:03.021534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:03.022252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2a42894d-df4c-4719-912b-81ee312a9079 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:03.023460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2a42894d-df4c-4719-912b-81ee312a9079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:03.052336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b38052-dc55-487e-b156-281f3d98853e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:03.082432 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1375/2760] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:03.083842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10da523-40bd-488b-9974-feba93f45642 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:03.084125 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10da523-40bd-488b-9974-feba93f45642 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:03.084428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10da523-40bd-488b-9974-feba93f45642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:03.102252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e10da523-40bd-488b-9974-feba93f45642 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:03.103489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e10da523-40bd-488b-9974-feba93f45642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:03.104547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b95ac5-65db-4e26-9bfb-165b1a20b1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:03.105306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95ac5-65db-4e26-9bfb-165b1a20b1fd service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:03.105566 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95ac5-65db-4e26-9bfb-165b1a20b1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:03.105837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95ac5-65db-4e26-9bfb-165b1a20b1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:03.107611 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-89b95ac5-65db-4e26-9bfb-165b1a20b1fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:03.111034 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1376/2761] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:03.111809 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10da523-40bd-488b-9974-feba93f45642 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:03.118545 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b95ac5-65db-4e26-9bfb-165b1a20b1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:03.120457 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b95ac5-65db-4e26-9bfb-165b1a20b1fd service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:03.121224 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10da523-40bd-488b-9974-feba93f45642 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:03.124775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84a215-9257-4a10-9ccc-bbae4859f86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:03.125415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84a215-9257-4a10-9ccc-bbae4859f86a service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:03.125695 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84a215-9257-4a10-9ccc-bbae4859f86a service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:03.125966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84a215-9257-4a10-9ccc-bbae4859f86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:03.129948 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1386/2762] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:03.130669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b95ac5-65db-4e26-9bfb-165b1a20b1fd service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:03.135305 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84a215-9257-4a10-9ccc-bbae4859f86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:03.136766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84a215-9257-4a10-9ccc-bbae4859f86a service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:03.140547 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b95ac5-65db-4e26-9bfb-165b1a20b1fd service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:03.144327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98135580-3dd9-410c-b548-bec1fc7b262a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:03.145099 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98135580-3dd9-410c-b548-bec1fc7b262a service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:03.145384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98135580-3dd9-410c-b548-bec1fc7b262a service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:03.145658 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98135580-3dd9-410c-b548-bec1fc7b262a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:03.148010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1377/2763] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:03.155620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98135580-3dd9-410c-b548-bec1fc7b262a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:03.157091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98135580-3dd9-410c-b548-bec1fc7b262a service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:03.166803 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1387/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:03.702365 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84a215-9257-4a10-9ccc-bbae4859f86a service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:03.704076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9c84a215-9257-4a10-9ccc-bbae4859f86a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:03.729561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84a215-9257-4a10-9ccc-bbae4859f86a service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:03.737653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:03.738977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:03.739410 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:03.739788 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] PATH_INFO: `/v3/projects/937175cd50d445aca27ced74e03fd1c3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:03.744807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=937175cd50d445aca27ced74e03fd1c3)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:03.748489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:03.831256 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937175cd50d445aca27ced74e03fd1c3', 'request_id': 'req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:03.844022 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937175cd50d445aca27ced74e03fd1c3', 'request_id': 'req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:03.854913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937175cd50d445aca27ced74e03fd1c3', 'request_id': 'req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:03.868250 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] The token cache is being invalidate because project 937175cd50d445aca27ced74e03fd1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:03.868824 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:03.870257 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:03.872756 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1378/2765] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:03 2022] DELETE /identity/v3/projects/937175cd50d445aca27ced74e03fd1c3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:03.876718 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98135580-3dd9-410c-b548-bec1fc7b262a service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:03.896721 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98135580-3dd9-410c-b548-bec1fc7b262a service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:03.971546 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:03.972679 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:03.973634 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:03.974021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] PATH_INFO: `/v3/users/6ac7715146124bef82708c283f017537` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:03.975935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac7715146124bef82708c283f017537)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:03.978228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:04.031596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac7715146124bef82708c283f017537'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:04.040009 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac7715146124bef82708c283f017537'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:04.040903 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac7715146124bef82708c283f017537'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:04.049811 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac7715146124bef82708c283f017537'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:04.050505 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f6e68fb3-8231-467d-9831-5cbfd5d0fe9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac7715146124bef82708c283f017537'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:04.058812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:04.075073 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1388/2766] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:03 2022] DELETE /identity/v3/users/6ac7715146124bef82708c283f017537 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:04.501511 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:04.503100 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:04.520919 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88dfc3-2932-4d26-b6bc-6ed91b4153cf admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:04.546576 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:04.596545 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:04.598807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:04.598807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:04.598807 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] PATH_INFO: `/v3/projects/d46728801353429bb46d9d28f973997d` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:04.599497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46728801353429bb46d9d28f973997d)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:04.601732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:04.662314 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46728801353429bb46d9d28f973997d', 'request_id': 'req-31f0f853-a15a-4f08-93d4-4cc120e73adc'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:04.673048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46728801353429bb46d9d28f973997d', 'request_id': 'req-31f0f853-a15a-4f08-93d4-4cc120e73adc'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:04.681766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46728801353429bb46d9d28f973997d', 'request_id': 'req-31f0f853-a15a-4f08-93d4-4cc120e73adc'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:04.706249 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] The token cache is being invalidate because project d46728801353429bb46d9d28f973997d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:04.706977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:04.709663 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-31f0f853-a15a-4f08-93d4-4cc120e73adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:04.716612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1379/2767] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:04 2022] DELETE /identity/v3/projects/d46728801353429bb46d9d28f973997d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:04.718669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae365121-f05b-4cca-85d8-beddc0026fda None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:04.719338 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae365121-f05b-4cca-85d8-beddc0026fda None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:04.719695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae365121-f05b-4cca-85d8-beddc0026fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:04.739497 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ae365121-f05b-4cca-85d8-beddc0026fda None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:04.740999 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ae365121-f05b-4cca-85d8-beddc0026fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:04.844570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1389/2768] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:04.852855 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0911ba1-1ad6-4bbf-9ae2-e6d304030334 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:04.853786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0911ba1-1ad6-4bbf-9ae2-e6d304030334 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:04.854108 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0911ba1-1ad6-4bbf-9ae2-e6d304030334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:04.883268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a0911ba1-1ad6-4bbf-9ae2-e6d304030334 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:04.884345 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a0911ba1-1ad6-4bbf-9ae2-e6d304030334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:04.901279 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae365121-f05b-4cca-85d8-beddc0026fda None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:04.901825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1380/2769] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:04.914782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae365121-f05b-4cca-85d8-beddc0026fda None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:04.921346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acf4d2-bca6-41a7-b407-caa423e91526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:04.922038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acf4d2-bca6-41a7-b407-caa423e91526 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:04.922323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acf4d2-bca6-41a7-b407-caa423e91526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:04.922604 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acf4d2-bca6-41a7-b407-caa423e91526 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:04.923598 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acf4d2-bca6-41a7-b407-caa423e91526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:04.924077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acf4d2-bca6-41a7-b407-caa423e91526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:04.927684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acf4d2-bca6-41a7-b407-caa423e91526 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:04.959074 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0911ba1-1ad6-4bbf-9ae2-e6d304030334 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:04.969036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1390/2770] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:04.970067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0911ba1-1ad6-4bbf-9ae2-e6d304030334 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:04.975922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16472d-d91d-4118-a48e-d6e153f2d64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:04.976718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16472d-d91d-4118-a48e-d6e153f2d64b admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:04.977003 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16472d-d91d-4118-a48e-d6e153f2d64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:04.977311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16472d-d91d-4118-a48e-d6e153f2d64b admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:04.978064 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16472d-d91d-4118-a48e-d6e153f2d64b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:04.980593 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16472d-d91d-4118-a48e-d6e153f2d64b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.030268 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acf4d2-bca6-41a7-b407-caa423e91526 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.043061 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1381/2771] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:04 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:05.043807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acf4d2-bca6-41a7-b407-caa423e91526 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.117456 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229f06-67d9-4423-a73b-3ff7c87fb4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.119912 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229f06-67d9-4423-a73b-3ff7c87fb4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.120206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229f06-67d9-4423-a73b-3ff7c87fb4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.120482 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229f06-67d9-4423-a73b-3ff7c87fb4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.121434 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63229f06-67d9-4423-a73b-3ff7c87fb4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.123690 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63229f06-67d9-4423-a73b-3ff7c87fb4d8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.156723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1391/2772] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:05 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:05.160182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16472d-d91d-4118-a48e-d6e153f2d64b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.173789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16472d-d91d-4118-a48e-d6e153f2d64b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.182337 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841b312-c91a-4d21-a632-9e50da3be11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.183973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b312-c91a-4d21-a632-9e50da3be11c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.184255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b312-c91a-4d21-a632-9e50da3be11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.184962 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b312-c91a-4d21-a632-9e50da3be11c admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.185362 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841b312-c91a-4d21-a632-9e50da3be11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.187204 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841b312-c91a-4d21-a632-9e50da3be11c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.215569 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229f06-67d9-4423-a73b-3ff7c87fb4d8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.227312 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1382/2773] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:05.230882 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229f06-67d9-4423-a73b-3ff7c87fb4d8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.243105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b77a1-1637-4140-a653-57a9128a9721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.244050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b77a1-1637-4140-a653-57a9128a9721 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.245036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b77a1-1637-4140-a653-57a9128a9721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.250473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b77a1-1637-4140-a653-57a9128a9721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.250473 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b77a1-1637-4140-a653-57a9128a9721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.255033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b77a1-1637-4140-a653-57a9128a9721 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.270686 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841b312-c91a-4d21-a632-9e50da3be11c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.271139 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1392/2774] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:05.286727 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841b312-c91a-4d21-a632-9e50da3be11c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.310130 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd296df-0d08-4e85-9e9d-36de53583806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.311280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd296df-0d08-4e85-9e9d-36de53583806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.311599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd296df-0d08-4e85-9e9d-36de53583806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.311945 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd296df-0d08-4e85-9e9d-36de53583806 admin admin] PATH_INFO: `/v3/projects/dead4d6205764b1ca6b5963dcfe3e447/users/e65db0e8e22c4c72b23b78ef4a48b7fb/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.330953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd296df-0d08-4e85-9e9d-36de53583806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dead4d6205764b1ca6b5963dcfe3e447, user_id=e65db0e8e22c4c72b23b78ef4a48b7fb, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.334279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd296df-0d08-4e85-9e9d-36de53583806 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.362464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1383/2775] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:05 2022] PUT /identity/v3/projects/dead4d6205764b1ca6b5963dcfe3e447/users/e65db0e8e22c4c72b23b78ef4a48b7fb/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:05.374231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41d63-ac60-4105-96ee-091bbc1d2416 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.374905 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41d63-ac60-4105-96ee-091bbc1d2416 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.375481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41d63-ac60-4105-96ee-091bbc1d2416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.419072 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e9f41d63-ac60-4105-96ee-091bbc1d2416 None None] MFA Rules not processed for user `e65db0e8e22c4c72b23b78ef4a48b7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:05.421925 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e9f41d63-ac60-4105-96ee-091bbc1d2416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:05.476962 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:05.507194 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1393/2776] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:05.512406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd296df-0d08-4e85-9e9d-36de53583806 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.582556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:05.602904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd296df-0d08-4e85-9e9d-36de53583806 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.612957 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f41b6b-fc02-483b-8563-ca3e0c5a0918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.613897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41b6b-fc02-483b-8563-ca3e0c5a0918 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.614575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41b6b-fc02-483b-8563-ca3e0c5a0918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.614852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41b6b-fc02-483b-8563-ca3e0c5a0918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.615995 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f41b6b-fc02-483b-8563-ca3e0c5a0918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.617699 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f41b6b-fc02-483b-8563-ca3e0c5a0918 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.651866 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1384/2777] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:05 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:05.653370 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f41d63-ac60-4105-96ee-091bbc1d2416 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.665075 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f41d63-ac60-4105-96ee-091bbc1d2416 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.734277 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc514827-4655-44f9-a256-5eba37669310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.734842 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc514827-4655-44f9-a256-5eba37669310 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.735230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc514827-4655-44f9-a256-5eba37669310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.735873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc514827-4655-44f9-a256-5eba37669310 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.736417 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc514827-4655-44f9-a256-5eba37669310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.738524 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc514827-4655-44f9-a256-5eba37669310 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.768388 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1394/2778] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:05 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:05.772411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f41b6b-fc02-483b-8563-ca3e0c5a0918 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.783636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f41b6b-fc02-483b-8563-ca3e0c5a0918 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.794948 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d23a-ee1e-45bc-9fc0-bc06371179fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.796076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d23a-ee1e-45bc-9fc0-bc06371179fb admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.796529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d23a-ee1e-45bc-9fc0-bc06371179fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.796977 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d23a-ee1e-45bc-9fc0-bc06371179fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.797864 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280d23a-ee1e-45bc-9fc0-bc06371179fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.799775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280d23a-ee1e-45bc-9fc0-bc06371179fb admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.827895 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1385/2779] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:05.828830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc514827-4655-44f9-a256-5eba37669310 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.844749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc514827-4655-44f9-a256-5eba37669310 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.863364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2472d-0b1d-43ad-a11f-ad96831f8945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.864440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2472d-0b1d-43ad-a11f-ad96831f8945 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.864763 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2472d-0b1d-43ad-a11f-ad96831f8945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.865041 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2472d-0b1d-43ad-a11f-ad96831f8945 admin admin] PATH_INFO: `/v3/projects/5054cce3e8b94ee19b18650f013818a7/users/ea548ff46c2d42e785dc07b737cc57e6/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.895527 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2472d-0b1d-43ad-a11f-ad96831f8945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5054cce3e8b94ee19b18650f013818a7, user_id=ea548ff46c2d42e785dc07b737cc57e6, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.898307 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2472d-0b1d-43ad-a11f-ad96831f8945 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.925338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d23a-ee1e-45bc-9fc0-bc06371179fb admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.925780 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1395/2780] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:05 2022] PUT /identity/v3/projects/5054cce3e8b94ee19b18650f013818a7/users/ea548ff46c2d42e785dc07b737cc57e6/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:26:05.937614 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d23a-ee1e-45bc-9fc0-bc06371179fb admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:06.067416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6258a-7ccc-4fff-bc62-27594a0fe023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:06.068115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6258a-7ccc-4fff-bc62-27594a0fe023 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:06.068395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6258a-7ccc-4fff-bc62-27594a0fe023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:06.068683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6258a-7ccc-4fff-bc62-27594a0fe023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:06.069437 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6258a-7ccc-4fff-bc62-27594a0fe023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:06.071054 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6258a-7ccc-4fff-bc62-27594a0fe023 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:06.083449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1386/2781] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:06.087684 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2472d-0b1d-43ad-a11f-ad96831f8945 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:06.100451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2472d-0b1d-43ad-a11f-ad96831f8945 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:06.105757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadd255-365c-4eab-97b1-10d89939f04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:06.106783 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd255-365c-4eab-97b1-10d89939f04c admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:06.107065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd255-365c-4eab-97b1-10d89939f04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:06.107332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd255-365c-4eab-97b1-10d89939f04c admin admin] PATH_INFO: `/v3/projects/5054cce3e8b94ee19b18650f013818a7/users/ea548ff46c2d42e785dc07b737cc57e6/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:06.109651 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadd255-365c-4eab-97b1-10d89939f04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5054cce3e8b94ee19b18650f013818a7, user_id=ea548ff46c2d42e785dc07b737cc57e6, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:06.112880 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadd255-365c-4eab-97b1-10d89939f04c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:06.137592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba093be-b062-4ed2-a7b2-aa01ab8b9930 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:06.137878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba093be-b062-4ed2-a7b2-aa01ab8b9930 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:06.138160 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba093be-b062-4ed2-a7b2-aa01ab8b9930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:06.139931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1396/2782] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:06 2022] PUT /identity/v3/projects/5054cce3e8b94ee19b18650f013818a7/users/ea548ff46c2d42e785dc07b737cc57e6/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:26:06.168691 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-eba093be-b062-4ed2-a7b2-aa01ab8b9930 None None] MFA Rules not processed for user `ea548ff46c2d42e785dc07b737cc57e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:06.170048 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-eba093be-b062-4ed2-a7b2-aa01ab8b9930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:06.264890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1387/2783] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:06.273969 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadd255-365c-4eab-97b1-10d89939f04c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:06.277356 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0cadd255-365c-4eab-97b1-10d89939f04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:06.390110 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadd255-365c-4eab-97b1-10d89939f04c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:06.398336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84520666-6d02-49c7-bb05-b64135f4de22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:06.398937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520666-6d02-49c7-bb05-b64135f4de22 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:06.399226 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520666-6d02-49c7-bb05-b64135f4de22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:06.399334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520666-6d02-49c7-bb05-b64135f4de22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:06.430282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84520666-6d02-49c7-bb05-b64135f4de22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:06.434293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84520666-6d02-49c7-bb05-b64135f4de22 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:06.481452 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1397/2784] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:06.528302 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba093be-b062-4ed2-a7b2-aa01ab8b9930 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:06.605127 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:06.622956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba093be-b062-4ed2-a7b2-aa01ab8b9930 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:06.628374 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:06.630120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:06.630120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:06.630120 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] PATH_INFO: `/v3/users/e65db0e8e22c4c72b23b78ef4a48b7fb` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:06.631497 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e65db0e8e22c4c72b23b78ef4a48b7fb)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:06.633591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:06.721137 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65db0e8e22c4c72b23b78ef4a48b7fb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:06.722098 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65db0e8e22c4c72b23b78ef4a48b7fb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:06.737821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65db0e8e22c4c72b23b78ef4a48b7fb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:06.749243 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65db0e8e22c4c72b23b78ef4a48b7fb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:06.750181 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65db0e8e22c4c72b23b78ef4a48b7fb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:06.795416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1388/2785] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:06 2022] DELETE /identity/v3/users/e65db0e8e22c4c72b23b78ef4a48b7fb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:06.800249 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710070d-8166-44ff-8407-6b5acd808707 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:06.800471 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710070d-8166-44ff-8407-6b5acd808707 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:06.800576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710070d-8166-44ff-8407-6b5acd808707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:06.837929 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f710070d-8166-44ff-8407-6b5acd808707 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:06.839326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f710070d-8166-44ff-8407-6b5acd808707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:06.909254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:06.951913 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1398/2786] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:26:06.971743 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:06.975008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:07.131232 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb24c87-2087-4a24-91ae-5e561619c197 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:07.137718 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11764-98dd-46dd-a3f9-9bb55e0c4f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:07.138642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11764-98dd-46dd-a3f9-9bb55e0c4f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:07.140041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11764-98dd-46dd-a3f9-9bb55e0c4f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:07.140482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11764-98dd-46dd-a3f9-9bb55e0c4f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:07.161909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b11764-98dd-46dd-a3f9-9bb55e0c4f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:07.164330 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b11764-98dd-46dd-a3f9-9bb55e0c4f68 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:07.178253 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1389/2787] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:07.734373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710070d-8166-44ff-8407-6b5acd808707 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:07.736396 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f710070d-8166-44ff-8407-6b5acd808707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:07.758807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710070d-8166-44ff-8407-6b5acd808707 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:07.771755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:07.772853 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:07.773902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:07.774661 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] PATH_INFO: `/v3/projects/dead4d6205764b1ca6b5963dcfe3e447` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:07.777914 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dead4d6205764b1ca6b5963dcfe3e447)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:07.783784 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:07.877089 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dead4d6205764b1ca6b5963dcfe3e447', 'request_id': 'req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:07.887518 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dead4d6205764b1ca6b5963dcfe3e447', 'request_id': 'req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:07.902582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dead4d6205764b1ca6b5963dcfe3e447', 'request_id': 'req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:07.916069 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] The token cache is being invalidate because project dead4d6205764b1ca6b5963dcfe3e447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:07.916504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:07.918449 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f216a64f-5c3c-45e5-84b1-c0f1e22ed73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:07.921184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1399/2788] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:07 2022] DELETE /identity/v3/projects/dead4d6205764b1ca6b5963dcfe3e447 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:07.925292 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11764-98dd-46dd-a3f9-9bb55e0c4f68 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:07.940738 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11764-98dd-46dd-a3f9-9bb55e0c4f68 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:08.035566 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:08.037272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:08.038556 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:08.038947 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] PATH_INFO: `/v3/users/ea548ff46c2d42e785dc07b737cc57e6` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:08.040308 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea548ff46c2d42e785dc07b737cc57e6)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:08.043821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:08.057411 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:08.108769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea548ff46c2d42e785dc07b737cc57e6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:08.109570 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea548ff46c2d42e785dc07b737cc57e6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:08.119615 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea548ff46c2d42e785dc07b737cc57e6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:08.128211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea548ff46c2d42e785dc07b737cc57e6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:08.128941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea548ff46c2d42e785dc07b737cc57e6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:08.148821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1390/2789] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:07 2022] DELETE /identity/v3/users/ea548ff46c2d42e785dc07b737cc57e6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:08.596101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5d2b9-104a-435e-b69c-edf2538d50f5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:08.596578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5d2b9-104a-435e-b69c-edf2538d50f5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:08.596712 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5d2b9-104a-435e-b69c-edf2538d50f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:08.627765 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-80c5d2b9-104a-435e-b69c-edf2538d50f5 None None] MFA Rules not processed for user `4899d5724cec43fb94a817ca8382a317`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:08.629096 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-80c5d2b9-104a-435e-b69c-edf2538d50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:08.710689 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1400/2790] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:08.715488 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:08.718067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:08.800854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fac538-2ccc-4581-9d15-73da6348d1ec admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:08.805888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2cd1-2fc7-4e88-a84a-a7a27b2609de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:08.806825 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2cd1-2fc7-4e88-a84a-a7a27b2609de admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:08.807169 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2cd1-2fc7-4e88-a84a-a7a27b2609de admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:08.807482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2cd1-2fc7-4e88-a84a-a7a27b2609de admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:08.808202 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae2cd1-2fc7-4e88-a84a-a7a27b2609de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:08.810272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae2cd1-2fc7-4e88-a84a-a7a27b2609de admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:08.842710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1391/2791] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:08 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:08.846409 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5d2b9-104a-435e-b69c-edf2538d50f5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:08.862516 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5d2b9-104a-435e-b69c-edf2538d50f5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:08.927060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:08.939669 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eda351-edb8-43bc-bc1e-1bb3e674649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:08.940777 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eda351-edb8-43bc-bc1e-1bb3e674649a admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:08.941242 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eda351-edb8-43bc-bc1e-1bb3e674649a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:08.941515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eda351-edb8-43bc-bc1e-1bb3e674649a admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:08.942295 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eda351-edb8-43bc-bc1e-1bb3e674649a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:08.944364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eda351-edb8-43bc-bc1e-1bb3e674649a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:08.970225 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1401/2792] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:08 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:08.971903 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2cd1-2fc7-4e88-a84a-a7a27b2609de admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:08.984635 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2cd1-2fc7-4e88-a84a-a7a27b2609de admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:08.994485 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa35df7-3e0d-4841-a3fb-866c2ebdd3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:08.995287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa35df7-3e0d-4841-a3fb-866c2ebdd3db admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:08.995639 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa35df7-3e0d-4841-a3fb-866c2ebdd3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:08.996030 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa35df7-3e0d-4841-a3fb-866c2ebdd3db admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:08.996897 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa35df7-3e0d-4841-a3fb-866c2ebdd3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:08.998651 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa35df7-3e0d-4841-a3fb-866c2ebdd3db admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.013848 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1392/2793] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:09.018674 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eda351-edb8-43bc-bc1e-1bb3e674649a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.031206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eda351-edb8-43bc-bc1e-1bb3e674649a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.036115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4659f-6093-4d4d-a781-a57beb19b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.037231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4659f-6093-4d4d-a781-a57beb19b492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.037519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4659f-6093-4d4d-a781-a57beb19b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.037800 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4659f-6093-4d4d-a781-a57beb19b492 admin admin] PATH_INFO: `/v3/projects/f8e3eb69c4ec46cea3f734330dcff72e/users/44d7a51d1b2a4ee7a673510d2bec32ca/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.054556 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4659f-6093-4d4d-a781-a57beb19b492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e3eb69c4ec46cea3f734330dcff72e, user_id=44d7a51d1b2a4ee7a673510d2bec32ca, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.057386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4659f-6093-4d4d-a781-a57beb19b492 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.072451 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1402/2794] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:09 2022] PUT /identity/v3/projects/f8e3eb69c4ec46cea3f734330dcff72e/users/44d7a51d1b2a4ee7a673510d2bec32ca/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:26:09.076416 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa35df7-3e0d-4841-a3fb-866c2ebdd3db admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.087720 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa35df7-3e0d-4841-a3fb-866c2ebdd3db admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.152281 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada2c81-126b-463d-906a-2169e70c2f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.153132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada2c81-126b-463d-906a-2169e70c2f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.153412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada2c81-126b-463d-906a-2169e70c2f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.153684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada2c81-126b-463d-906a-2169e70c2f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.154414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada2c81-126b-463d-906a-2169e70c2f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.156051 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada2c81-126b-463d-906a-2169e70c2f31 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.158495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:09.171655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1393/2795] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:09.172940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4659f-6093-4d4d-a781-a57beb19b492 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.185266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4659f-6093-4d4d-a781-a57beb19b492 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.193319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada2c81-126b-463d-906a-2169e70c2f31 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.194108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d067193-c1e2-4fa2-8893-183134b17ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.195159 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2ada2c81-126b-463d-906a-2169e70c2f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:09.195530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d067193-c1e2-4fa2-8893-183134b17ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.195815 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d067193-c1e2-4fa2-8893-183134b17ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.196115 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d067193-c1e2-4fa2-8893-183134b17ba7 admin admin] PATH_INFO: `/v3/projects/f8e3eb69c4ec46cea3f734330dcff72e/users/44d7a51d1b2a4ee7a673510d2bec32ca/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.198432 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d067193-c1e2-4fa2-8893-183134b17ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e3eb69c4ec46cea3f734330dcff72e, user_id=44d7a51d1b2a4ee7a673510d2bec32ca, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.201177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d067193-c1e2-4fa2-8893-183134b17ba7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.212901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1403/2796] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:09 2022] PUT /identity/v3/projects/f8e3eb69c4ec46cea3f734330dcff72e/users/44d7a51d1b2a4ee7a673510d2bec32ca/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:09.215252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada2c81-126b-463d-906a-2169e70c2f31 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.299238 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.300155 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.300440 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.300744 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] PATH_INFO: `/v3/projects/5054cce3e8b94ee19b18650f013818a7` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.301976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5054cce3e8b94ee19b18650f013818a7)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.303933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.354026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5054cce3e8b94ee19b18650f013818a7', 'request_id': 'req-33417b9f-e74b-42f2-97c6-b56771fdb1d9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:09.366941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5054cce3e8b94ee19b18650f013818a7', 'request_id': 'req-33417b9f-e74b-42f2-97c6-b56771fdb1d9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:09.374604 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5054cce3e8b94ee19b18650f013818a7', 'request_id': 'req-33417b9f-e74b-42f2-97c6-b56771fdb1d9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:09.387917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] The token cache is being invalidate because project 5054cce3e8b94ee19b18650f013818a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:09.388423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:09.389518 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-33417b9f-e74b-42f2-97c6-b56771fdb1d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:09.391167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1394/2797] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:09 2022] DELETE /identity/v3/projects/5054cce3e8b94ee19b18650f013818a7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:09.396375 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18af3-e92f-4513-878b-38142ff40a71 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.396810 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18af3-e92f-4513-878b-38142ff40a71 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.397342 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18af3-e92f-4513-878b-38142ff40a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.420152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-87d18af3-e92f-4513-878b-38142ff40a71 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:09.421407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-87d18af3-e92f-4513-878b-38142ff40a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:09.487397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1404/2798] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:26:09.494901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55dfb-37b4-4d8d-9526-568292e251e0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.495415 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55dfb-37b4-4d8d-9526-568292e251e0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.495755 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55dfb-37b4-4d8d-9526-568292e251e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.519201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3eb55dfb-37b4-4d8d-9526-568292e251e0 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:09.520575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3eb55dfb-37b4-4d8d-9526-568292e251e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:09.528915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1395/2799] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:26:09.533227 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18af3-e92f-4513-878b-38142ff40a71 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.543848 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18af3-e92f-4513-878b-38142ff40a71 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.549478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17457b7f-a7fa-48f7-9b2d-ea145ff93b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.550294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17457b7f-a7fa-48f7-9b2d-ea145ff93b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.550580 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17457b7f-a7fa-48f7-9b2d-ea145ff93b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.550856 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17457b7f-a7fa-48f7-9b2d-ea145ff93b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.551592 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17457b7f-a7fa-48f7-9b2d-ea145ff93b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:09.551898 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17457b7f-a7fa-48f7-9b2d-ea145ff93b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.554576 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17457b7f-a7fa-48f7-9b2d-ea145ff93b6a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.584952 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1405/2800] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:09.589210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb55dfb-37b4-4d8d-9526-568292e251e0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.618254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb55dfb-37b4-4d8d-9526-568292e251e0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.624732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e314f-2a07-4ba4-9f08-d6b11a452881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.625489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e314f-2a07-4ba4-9f08-d6b11a452881 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.625781 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e314f-2a07-4ba4-9f08-d6b11a452881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.626056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e314f-2a07-4ba4-9f08-d6b11a452881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.626821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e314f-2a07-4ba4-9f08-d6b11a452881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.629450 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e314f-2a07-4ba4-9f08-d6b11a452881 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.666648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1396/2801] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:09 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:09.670549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17457b7f-a7fa-48f7-9b2d-ea145ff93b6a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.680862 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17457b7f-a7fa-48f7-9b2d-ea145ff93b6a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.752325 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768302ca-73e5-48be-8f2e-a985b20f2b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.753036 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768302ca-73e5-48be-8f2e-a985b20f2b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.753324 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768302ca-73e5-48be-8f2e-a985b20f2b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.753596 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768302ca-73e5-48be-8f2e-a985b20f2b82 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.754301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768302ca-73e5-48be-8f2e-a985b20f2b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.757198 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768302ca-73e5-48be-8f2e-a985b20f2b82 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.800052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1406/2802] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:09 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:09.804002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e314f-2a07-4ba4-9f08-d6b11a452881 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.825489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e314f-2a07-4ba4-9f08-d6b11a452881 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.831526 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84b56-1f91-49b7-93f3-b39e84a07826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.832976 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84b56-1f91-49b7-93f3-b39e84a07826 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.833471 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84b56-1f91-49b7-93f3-b39e84a07826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.833951 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84b56-1f91-49b7-93f3-b39e84a07826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.835010 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b84b56-1f91-49b7-93f3-b39e84a07826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.836853 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b84b56-1f91-49b7-93f3-b39e84a07826 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.855436 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1397/2803] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:26:09.856696 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768302ca-73e5-48be-8f2e-a985b20f2b82 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.868050 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768302ca-73e5-48be-8f2e-a985b20f2b82 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.874309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410fc2b-60a6-4e64-b394-f869b443714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.874309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410fc2b-60a6-4e64-b394-f869b443714b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.874585 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410fc2b-60a6-4e64-b394-f869b443714b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.874855 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410fc2b-60a6-4e64-b394-f869b443714b admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.875655 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410fc2b-60a6-4e64-b394-f869b443714b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.877367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410fc2b-60a6-4e64-b394-f869b443714b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.892522 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1407/2804] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:09.894306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84b56-1f91-49b7-93f3-b39e84a07826 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.905953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84b56-1f91-49b7-93f3-b39e84a07826 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.911671 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eda4d-4332-4847-97ca-670bf3d22d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.912761 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eda4d-4332-4847-97ca-670bf3d22d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.913133 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eda4d-4332-4847-97ca-670bf3d22d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.913504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eda4d-4332-4847-97ca-670bf3d22d38 admin admin] PATH_INFO: `/v3/projects/b6b5e9bf0a3444c2ad590e9376c68b96/users/88f2dd6b8a4442cbaae396dd0b9564e8/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.936339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eda4d-4332-4847-97ca-670bf3d22d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b5e9bf0a3444c2ad590e9376c68b96, user_id=88f2dd6b8a4442cbaae396dd0b9564e8, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.939852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eda4d-4332-4847-97ca-670bf3d22d38 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.958834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1398/2805] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:09 2022] PUT /identity/v3/projects/b6b5e9bf0a3444c2ad590e9376c68b96/users/88f2dd6b8a4442cbaae396dd0b9564e8/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:26:09.971124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dba54-fb99-4984-8344-537cf7191640 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.971463 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dba54-fb99-4984-8344-537cf7191640 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.971786 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dba54-fb99-4984-8344-537cf7191640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.996972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:10.010494 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a44dba54-fb99-4984-8344-537cf7191640 None None] MFA Rules not processed for user `88f2dd6b8a4442cbaae396dd0b9564e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:10.013361 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a44dba54-fb99-4984-8344-537cf7191640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:10.103293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1408/2806] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:10.108272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eda4d-4332-4847-97ca-670bf3d22d38 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:10.140710 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:10.184176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eda4d-4332-4847-97ca-670bf3d22d38 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:10.191338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a392f3-a232-4fec-9c58-40079d6dc92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:10.191338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a392f3-a232-4fec-9c58-40079d6dc92f admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:10.191338 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a392f3-a232-4fec-9c58-40079d6dc92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:10.191775 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a392f3-a232-4fec-9c58-40079d6dc92f admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:10.192244 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a392f3-a232-4fec-9c58-40079d6dc92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:10.194203 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a392f3-a232-4fec-9c58-40079d6dc92f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:10.224706 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1399/2807] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:10 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:10.229820 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44dba54-fb99-4984-8344-537cf7191640 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:10.243191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44dba54-fb99-4984-8344-537cf7191640 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:10.319450 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed3849-df04-463f-99ea-c9d5de40311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:10.320395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed3849-df04-463f-99ea-c9d5de40311e admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:10.320902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed3849-df04-463f-99ea-c9d5de40311e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:10.321280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed3849-df04-463f-99ea-c9d5de40311e admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:10.322616 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed3849-df04-463f-99ea-c9d5de40311e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:10.324641 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed3849-df04-463f-99ea-c9d5de40311e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:10.351754 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1409/2808] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:10 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:10.355913 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a392f3-a232-4fec-9c58-40079d6dc92f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:10.374963 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a392f3-a232-4fec-9c58-40079d6dc92f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:10.384269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648126da-6dc5-41fe-9e86-45729488366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:10.384269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648126da-6dc5-41fe-9e86-45729488366d admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:10.384269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648126da-6dc5-41fe-9e86-45729488366d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:10.384269 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648126da-6dc5-41fe-9e86-45729488366d admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:10.386377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648126da-6dc5-41fe-9e86-45729488366d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:10.386377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648126da-6dc5-41fe-9e86-45729488366d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:10.404505 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1400/2809] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:10.405504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed3849-df04-463f-99ea-c9d5de40311e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:10.416595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed3849-df04-463f-99ea-c9d5de40311e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:10.421778 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b63877-7fce-4a67-82a1-887e2bed6ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:10.423185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b63877-7fce-4a67-82a1-887e2bed6ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:10.423339 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b63877-7fce-4a67-82a1-887e2bed6ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:10.423649 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b63877-7fce-4a67-82a1-887e2bed6ae3 admin admin] PATH_INFO: `/v3/projects/2262b8b1152945b48661ec9d06ef768d/users/5376a3bb06a84a699f728c61c6caa7c2/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:10.447702 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b63877-7fce-4a67-82a1-887e2bed6ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2262b8b1152945b48661ec9d06ef768d, user_id=5376a3bb06a84a699f728c61c6caa7c2, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:10.450680 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b63877-7fce-4a67-82a1-887e2bed6ae3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:10.472368 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1410/2810] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:10 2022] PUT /identity/v3/projects/2262b8b1152945b48661ec9d06ef768d/users/5376a3bb06a84a699f728c61c6caa7c2/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:10.476582 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648126da-6dc5-41fe-9e86-45729488366d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:10.488121 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648126da-6dc5-41fe-9e86-45729488366d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:10.554568 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef3a98-6038-4058-8755-66492a8d9370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:10.555791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef3a98-6038-4058-8755-66492a8d9370 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:10.555791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef3a98-6038-4058-8755-66492a8d9370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:10.555791 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef3a98-6038-4058-8755-66492a8d9370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:10.556584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef3a98-6038-4058-8755-66492a8d9370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:10.558261 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef3a98-6038-4058-8755-66492a8d9370 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:10.572943 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1401/2811] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:26:10.582586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b63877-7fce-4a67-82a1-887e2bed6ae3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:10.603392 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b63877-7fce-4a67-82a1-887e2bed6ae3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:10.609495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01f688-9f4e-475b-ac3f-956b48c8b28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:10.610422 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01f688-9f4e-475b-ac3f-956b48c8b28f admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:10.610708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01f688-9f4e-475b-ac3f-956b48c8b28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:10.610987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01f688-9f4e-475b-ac3f-956b48c8b28f admin admin] PATH_INFO: `/v3/projects/2262b8b1152945b48661ec9d06ef768d/users/5376a3bb06a84a699f728c61c6caa7c2/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:10.613025 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01f688-9f4e-475b-ac3f-956b48c8b28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2262b8b1152945b48661ec9d06ef768d, user_id=5376a3bb06a84a699f728c61c6caa7c2, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:10.615926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01f688-9f4e-475b-ac3f-956b48c8b28f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:10.639539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1411/2812] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:10 2022] PUT /identity/v3/projects/2262b8b1152945b48661ec9d06ef768d/users/5376a3bb06a84a699f728c61c6caa7c2/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:10.643636 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1952f4f-4ea6-4121-98d1-6142bbe734c5 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:10.643933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1952f4f-4ea6-4121-98d1-6142bbe734c5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:10.644211 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1952f4f-4ea6-4121-98d1-6142bbe734c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:10.675235 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c1952f4f-4ea6-4121-98d1-6142bbe734c5 None None] MFA Rules not processed for user `5376a3bb06a84a699f728c61c6caa7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:10.676467 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c1952f4f-4ea6-4121-98d1-6142bbe734c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:10.766373 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1402/2813] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:10.779507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01f688-9f4e-475b-ac3f-956b48c8b28f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:10.781346 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-df01f688-9f4e-475b-ac3f-956b48c8b28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:10.859932 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01f688-9f4e-475b-ac3f-956b48c8b28f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:10.864001 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fc7d6-0466-40ae-b35e-08542f454376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:10.864772 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fc7d6-0466-40ae-b35e-08542f454376 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:10.865083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fc7d6-0466-40ae-b35e-08542f454376 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:10.865465 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fc7d6-0466-40ae-b35e-08542f454376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:10.873526 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:10.933758 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fc7d6-0466-40ae-b35e-08542f454376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:10.935469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fc7d6-0466-40ae-b35e-08542f454376 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:10.946114 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1412/2814] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:12.402408 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1952f4f-4ea6-4121-98d1-6142bbe734c5 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:12.403915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c1952f4f-4ea6-4121-98d1-6142bbe734c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:12.418290 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1952f4f-4ea6-4121-98d1-6142bbe734c5 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:12.427082 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45dd7d-adba-42fe-97e6-b9f16bbf881d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:12.427831 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45dd7d-adba-42fe-97e6-b9f16bbf881d service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:12.428393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45dd7d-adba-42fe-97e6-b9f16bbf881d service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:12.428707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45dd7d-adba-42fe-97e6-b9f16bbf881d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:12.458079 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45dd7d-adba-42fe-97e6-b9f16bbf881d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:12.459546 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45dd7d-adba-42fe-97e6-b9f16bbf881d service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:12.484390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1403/2815] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:14.605722 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a4a6-feff-41e6-bd45-a45d478f6947 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:14.606293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a4a6-feff-41e6-bd45-a45d478f6947 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:14.606293 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a4a6-feff-41e6-bd45-a45d478f6947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:14.654531 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e7c4a4a6-feff-41e6-bd45-a45d478f6947 None None] MFA Rules not processed for user `44d7a51d1b2a4ee7a673510d2bec32ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:14.657012 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e7c4a4a6-feff-41e6-bd45-a45d478f6947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:14.801538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1413/2816] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:14.815413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45dd7d-adba-42fe-97e6-b9f16bbf881d service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:14.817201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8e45dd7d-adba-42fe-97e6-b9f16bbf881d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:14.833050 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:14.934634 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45dd7d-adba-42fe-97e6-b9f16bbf881d service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:14.941056 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531f6dc-edf0-4c43-a36f-a4216dcb63dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:14.943132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531f6dc-edf0-4c43-a36f-a4216dcb63dc service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:14.943591 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531f6dc-edf0-4c43-a36f-a4216dcb63dc service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:14.944020 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531f6dc-edf0-4c43-a36f-a4216dcb63dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:14.949946 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6531f6dc-edf0-4c43-a36f-a4216dcb63dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:15.042458 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531f6dc-edf0-4c43-a36f-a4216dcb63dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:15.045390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531f6dc-edf0-4c43-a36f-a4216dcb63dc service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:15.078318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1404/2817] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:16.176197 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395398b-a799-4f5d-af85-3f79c720013d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:16.176692 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395398b-a799-4f5d-af85-3f79c720013d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:16.177054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395398b-a799-4f5d-af85-3f79c720013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:16.198046 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e395398b-a799-4f5d-af85-3f79c720013d None None] MFA Rules not processed for user `4899d5724cec43fb94a817ca8382a317`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:16.199372 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e395398b-a799-4f5d-af85-3f79c720013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:16.207341 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1414/2818] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:16.470025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531f6dc-edf0-4c43-a36f-a4216dcb63dc service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:16.482340 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531f6dc-edf0-4c43-a36f-a4216dcb63dc service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:16.487326 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d93349-dafe-4988-b39f-d034478d259b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:16.488182 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d93349-dafe-4988-b39f-d034478d259b service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:16.488720 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d93349-dafe-4988-b39f-d034478d259b service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:16.489153 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d93349-dafe-4988-b39f-d034478d259b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:16.493854 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-78d93349-dafe-4988-b39f-d034478d259b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:16.736489 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d93349-dafe-4988-b39f-d034478d259b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:16.737988 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d93349-dafe-4988-b39f-d034478d259b service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:16.758885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1405/2819] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:16.930126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395398b-a799-4f5d-af85-3f79c720013d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:17.018016 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395398b-a799-4f5d-af85-3f79c720013d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:17.022847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:17.023833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:17.024184 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:17.024548 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] PATH_INFO: `/v3/users/88f2dd6b8a4442cbaae396dd0b9564e8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:17.025937 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f2dd6b8a4442cbaae396dd0b9564e8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:17.028022 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:17.060967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:17.088476 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f2dd6b8a4442cbaae396dd0b9564e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:17.099940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f2dd6b8a4442cbaae396dd0b9564e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:17.100620 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f2dd6b8a4442cbaae396dd0b9564e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:17.108254 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f2dd6b8a4442cbaae396dd0b9564e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:17.108980 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f2dd6b8a4442cbaae396dd0b9564e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:17.133568 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1415/2820] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:16 2022] DELETE /identity/v3/users/88f2dd6b8a4442cbaae396dd0b9564e8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:17.138941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da610-d33a-4642-9ad9-355a519e3853 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:17.139667 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da610-d33a-4642-9ad9-355a519e3853 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:17.140014 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da610-d33a-4642-9ad9-355a519e3853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:17.161042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5c3da610-d33a-4642-9ad9-355a519e3853 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:17.162428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5c3da610-d33a-4642-9ad9-355a519e3853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:17.221830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:17.278112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1406/2821] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:17.288687 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:17.291126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:17.381230 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f9239-30a9-4f56-9133-d5b6f2154cf6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:17.385398 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b20331-ef03-49ec-8a3a-1cc11325a44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:17.386105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b20331-ef03-49ec-8a3a-1cc11325a44d service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:17.386390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b20331-ef03-49ec-8a3a-1cc11325a44d service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:17.386667 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b20331-ef03-49ec-8a3a-1cc11325a44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:17.402646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b20331-ef03-49ec-8a3a-1cc11325a44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:17.405407 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b20331-ef03-49ec-8a3a-1cc11325a44d service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:17.431192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1416/2822] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:17.891286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da610-d33a-4642-9ad9-355a519e3853 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:17.892935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5c3da610-d33a-4642-9ad9-355a519e3853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:17.906938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da610-d33a-4642-9ad9-355a519e3853 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:17.917429 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:17.918648 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:17.918910 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:17.919327 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] PATH_INFO: `/v3/projects/b6b5e9bf0a3444c2ad590e9376c68b96` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:17.920990 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b5e9bf0a3444c2ad590e9376c68b96)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:17.922956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:17.984270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b5e9bf0a3444c2ad590e9376c68b96', 'request_id': 'req-8a620ec2-b6e2-4dca-ac02-063456f9296f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:17.994320 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b5e9bf0a3444c2ad590e9376c68b96', 'request_id': 'req-8a620ec2-b6e2-4dca-ac02-063456f9296f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.003167 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b5e9bf0a3444c2ad590e9376c68b96', 'request_id': 'req-8a620ec2-b6e2-4dca-ac02-063456f9296f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.016336 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] The token cache is being invalidate because project b6b5e9bf0a3444c2ad590e9376c68b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:18.016623 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.017423 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.018994 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1407/2823] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:17 2022] DELETE /identity/v3/projects/b6b5e9bf0a3444c2ad590e9376c68b96 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:18.023163 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b20331-ef03-49ec-8a3a-1cc11325a44d service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:18.035215 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b20331-ef03-49ec-8a3a-1cc11325a44d service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:18.100384 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:18.101376 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:18.101745 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:18.102091 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] PATH_INFO: `/v3/users/5376a3bb06a84a699f728c61c6caa7c2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:18.104083 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5376a3bb06a84a699f728c61c6caa7c2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:18.106185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:18.166764 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5376a3bb06a84a699f728c61c6caa7c2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.169553 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:18.176334 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5376a3bb06a84a699f728c61c6caa7c2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.177081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5376a3bb06a84a699f728c61c6caa7c2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.185698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5376a3bb06a84a699f728c61c6caa7c2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.186387 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0f1b6ab3-c1ca-41fa-a109-39c74e6b8f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5376a3bb06a84a699f728c61c6caa7c2'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.208779 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1417/2824] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:18 2022] DELETE /identity/v3/users/5376a3bb06a84a699f728c61c6caa7c2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:18.568445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:18.570021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:18.591026 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a620ec2-b6e2-4dca-ac02-063456f9296f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:18.657186 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:18.658491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:18.658972 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:18.659433 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] PATH_INFO: `/v3/projects/2262b8b1152945b48661ec9d06ef768d` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:18.660753 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2262b8b1152945b48661ec9d06ef768d)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:18.662724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:18.717021 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2262b8b1152945b48661ec9d06ef768d', 'request_id': 'req-fe1d41e5-c0a9-488f-b41d-d93457d47921'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.725299 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2262b8b1152945b48661ec9d06ef768d', 'request_id': 'req-fe1d41e5-c0a9-488f-b41d-d93457d47921'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.733741 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2262b8b1152945b48661ec9d06ef768d', 'request_id': 'req-fe1d41e5-c0a9-488f-b41d-d93457d47921'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.740380 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:18.752878 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] The token cache is being invalidate because project 2262b8b1152945b48661ec9d06ef768d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:18.753659 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.754730 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fe1d41e5-c0a9-488f-b41d-d93457d47921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:18.756311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1408/2825] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:18 2022] DELETE /identity/v3/projects/2262b8b1152945b48661ec9d06ef768d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:18.761496 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba941d9c-d33a-448f-a60f-2471f9c342ab None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:18.761949 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba941d9c-d33a-448f-a60f-2471f9c342ab None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:18.762274 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba941d9c-d33a-448f-a60f-2471f9c342ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:18.782276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ba941d9c-d33a-448f-a60f-2471f9c342ab None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:18.783550 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ba941d9c-d33a-448f-a60f-2471f9c342ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:18.856301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1418/2826] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:18.864684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce017534-0c2e-4638-b2d3-817bc088342a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:18.865041 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce017534-0c2e-4638-b2d3-817bc088342a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:18.865283 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce017534-0c2e-4638-b2d3-817bc088342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:18.886955 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ce017534-0c2e-4638-b2d3-817bc088342a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:18.888459 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ce017534-0c2e-4638-b2d3-817bc088342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:18.897465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1409/2827] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:26:18.902904 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba941d9c-d33a-448f-a60f-2471f9c342ab None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:18.914258 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba941d9c-d33a-448f-a60f-2471f9c342ab None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:18.919490 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a502e65-c22e-4094-8555-c2bdbd5adbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:18.920219 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a502e65-c22e-4094-8555-c2bdbd5adbec admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:18.920504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a502e65-c22e-4094-8555-c2bdbd5adbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:18.920861 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a502e65-c22e-4094-8555-c2bdbd5adbec admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:18.921629 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a502e65-c22e-4094-8555-c2bdbd5adbec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:18.921938 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a502e65-c22e-4094-8555-c2bdbd5adbec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:18.923640 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a502e65-c22e-4094-8555-c2bdbd5adbec admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:18.937376 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1419/2828] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:18.942096 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce017534-0c2e-4638-b2d3-817bc088342a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:18.952464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce017534-0c2e-4638-b2d3-817bc088342a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:18.959583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e2f03-1d76-4e09-9b66-603599c3d82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:18.960310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2f03-1d76-4e09-9b66-603599c3d82a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:18.960596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2f03-1d76-4e09-9b66-603599c3d82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:18.960902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2f03-1d76-4e09-9b66-603599c3d82a admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:18.961638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e2f03-1d76-4e09-9b66-603599c3d82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:18.963637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e2f03-1d76-4e09-9b66-603599c3d82a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.003206 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1410/2829] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:18 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:19.007813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a502e65-c22e-4094-8555-c2bdbd5adbec admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.019889 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a502e65-c22e-4094-8555-c2bdbd5adbec admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.090732 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c1890-c996-46c6-8169-7190464b8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.093154 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c1890-c996-46c6-8169-7190464b8e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.093458 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c1890-c996-46c6-8169-7190464b8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.093744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c1890-c996-46c6-8169-7190464b8e51 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.094488 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c1890-c996-46c6-8169-7190464b8e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.096866 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c1890-c996-46c6-8169-7190464b8e51 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.126152 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1420/2830] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:19 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:19.130658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e2f03-1d76-4e09-9b66-603599c3d82a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.143583 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e2f03-1d76-4e09-9b66-603599c3d82a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.154898 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173c3ce-e179-43d5-ab0b-8f52efb93776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.155647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173c3ce-e179-43d5-ab0b-8f52efb93776 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.155936 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173c3ce-e179-43d5-ab0b-8f52efb93776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.156210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173c3ce-e179-43d5-ab0b-8f52efb93776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.157024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173c3ce-e179-43d5-ab0b-8f52efb93776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.158683 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173c3ce-e179-43d5-ab0b-8f52efb93776 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.172915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1411/2831] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:19.174107 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c1890-c996-46c6-8169-7190464b8e51 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.187899 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c1890-c996-46c6-8169-7190464b8e51 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.194209 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011cb571-327e-4645-955b-84873f5a0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.194940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cb571-327e-4645-955b-84873f5a0f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.195223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cb571-327e-4645-955b-84873f5a0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.195499 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cb571-327e-4645-955b-84873f5a0f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.196333 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cb571-327e-4645-955b-84873f5a0f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.198280 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cb571-327e-4645-955b-84873f5a0f06 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.209171 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1421/2832] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:19.214063 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173c3ce-e179-43d5-ab0b-8f52efb93776 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.224837 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173c3ce-e179-43d5-ab0b-8f52efb93776 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.230421 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c1bf9-6be3-4278-b91b-5a05d834581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.231375 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1bf9-6be3-4278-b91b-5a05d834581e admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.231654 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1bf9-6be3-4278-b91b-5a05d834581e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.231940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1bf9-6be3-4278-b91b-5a05d834581e admin admin] PATH_INFO: `/v3/projects/c048871cbc8745c8bdbb994c4438330d/users/496e12b431ce449ab37e977a249a9eb7/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.249268 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c1bf9-6be3-4278-b91b-5a05d834581e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c048871cbc8745c8bdbb994c4438330d, user_id=496e12b431ce449ab37e977a249a9eb7, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.251958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c1bf9-6be3-4278-b91b-5a05d834581e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.269933 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1412/2833] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:19 2022] PUT /identity/v3/projects/c048871cbc8745c8bdbb994c4438330d/users/496e12b431ce449ab37e977a249a9eb7/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:19.282248 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852378-04d2-453b-a221-20375ed5bb70 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.282534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852378-04d2-453b-a221-20375ed5bb70 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.282812 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852378-04d2-453b-a221-20375ed5bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.317871 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d0852378-04d2-453b-a221-20375ed5bb70 None None] MFA Rules not processed for user `496e12b431ce449ab37e977a249a9eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:19.319367 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d0852378-04d2-453b-a221-20375ed5bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:19.342047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:19.408310 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1422/2834] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:19.412495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c1bf9-6be3-4278-b91b-5a05d834581e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.485481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c1bf9-6be3-4278-b91b-5a05d834581e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.490342 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a7e05-9f7c-4f39-b206-bffd3f9e0a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.490992 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a7e05-9f7c-4f39-b206-bffd3f9e0a13 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.491297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a7e05-9f7c-4f39-b206-bffd3f9e0a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.491647 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a7e05-9f7c-4f39-b206-bffd3f9e0a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.492234 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a7e05-9f7c-4f39-b206-bffd3f9e0a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.495160 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a7e05-9f7c-4f39-b206-bffd3f9e0a13 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.525834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1413/2835] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:19 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:19.529773 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0852378-04d2-453b-a221-20375ed5bb70 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.540979 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0852378-04d2-453b-a221-20375ed5bb70 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.606260 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed13f1-a1f3-4f52-a2b2-619bf69b97de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.606960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed13f1-a1f3-4f52-a2b2-619bf69b97de admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.607299 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed13f1-a1f3-4f52-a2b2-619bf69b97de admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.607582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed13f1-a1f3-4f52-a2b2-619bf69b97de admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.608306 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed13f1-a1f3-4f52-a2b2-619bf69b97de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.610349 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed13f1-a1f3-4f52-a2b2-619bf69b97de admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.635613 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1423/2836] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:19 2022] POST /identity/v3/users => generated 301 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:19.636900 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a7e05-9f7c-4f39-b206-bffd3f9e0a13 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.648805 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a7e05-9f7c-4f39-b206-bffd3f9e0a13 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.660025 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbfce0-5c9d-4a43-a601-04ff59fd11f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.660642 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbfce0-5c9d-4a43-a601-04ff59fd11f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.660968 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbfce0-5c9d-4a43-a601-04ff59fd11f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.661247 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbfce0-5c9d-4a43-a601-04ff59fd11f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.661997 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbfce0-5c9d-4a43-a601-04ff59fd11f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.663705 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbfce0-5c9d-4a43-a601-04ff59fd11f2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.676555 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1414/2837] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:19.681577 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed13f1-a1f3-4f52-a2b2-619bf69b97de admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.693530 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed13f1-a1f3-4f52-a2b2-619bf69b97de admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.698697 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fff01-1573-4cd4-a2d6-7106377f0f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.699708 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fff01-1573-4cd4-a2d6-7106377f0f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.700082 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fff01-1573-4cd4-a2d6-7106377f0f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.700389 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fff01-1573-4cd4-a2d6-7106377f0f5e admin admin] PATH_INFO: `/v3/projects/50cfb626631742ada5a0a826c687214f/users/a9d8ccb7666c4dec9cdda893b50cdb97/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.717935 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fff01-1573-4cd4-a2d6-7106377f0f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cfb626631742ada5a0a826c687214f, user_id=a9d8ccb7666c4dec9cdda893b50cdb97, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.721355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fff01-1573-4cd4-a2d6-7106377f0f5e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.741519 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1424/2838] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:19 2022] PUT /identity/v3/projects/50cfb626631742ada5a0a826c687214f/users/a9d8ccb7666c4dec9cdda893b50cdb97/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:19.742949 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbfce0-5c9d-4a43-a601-04ff59fd11f2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.757307 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbfce0-5c9d-4a43-a601-04ff59fd11f2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.858697 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914a1c1-d5c1-4a9c-9331-a3a6d198a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.859445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914a1c1-d5c1-4a9c-9331-a3a6d198a2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.859727 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914a1c1-d5c1-4a9c-9331-a3a6d198a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.860004 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914a1c1-d5c1-4a9c-9331-a3a6d198a2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.860796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914a1c1-d5c1-4a9c-9331-a3a6d198a2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.862465 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914a1c1-d5c1-4a9c-9331-a3a6d198a2cf admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.864974 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:19.886227 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1415/2839] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:19.887487 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fff01-1573-4cd4-a2d6-7106377f0f5e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.899020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fff01-1573-4cd4-a2d6-7106377f0f5e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.908474 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1121f-852e-43e9-9cbb-5419ba1a7ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.913975 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1121f-852e-43e9-9cbb-5419ba1a7ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.914185 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1121f-852e-43e9-9cbb-5419ba1a7ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.914533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1121f-852e-43e9-9cbb-5419ba1a7ae3 admin admin] PATH_INFO: `/v3/projects/50cfb626631742ada5a0a826c687214f/users/a9d8ccb7666c4dec9cdda893b50cdb97/roles/6bfa68fd285f44978fab7051ae8d8f38` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.917543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1121f-852e-43e9-9cbb-5419ba1a7ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cfb626631742ada5a0a826c687214f, user_id=a9d8ccb7666c4dec9cdda893b50cdb97, role_id=6bfa68fd285f44978fab7051ae8d8f38)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.920285 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1121f-852e-43e9-9cbb-5419ba1a7ae3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.934003 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1425/2840] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:19 2022] PUT /identity/v3/projects/50cfb626631742ada5a0a826c687214f/users/a9d8ccb7666c4dec9cdda893b50cdb97/roles/6bfa68fd285f44978fab7051ae8d8f38 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:26:19.944115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a490e8-bdb6-4a39-b5c1-3c9ad48d233d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.945430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a490e8-bdb6-4a39-b5c1-3c9ad48d233d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.945430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a490e8-bdb6-4a39-b5c1-3c9ad48d233d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.988287 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f5a490e8-bdb6-4a39-b5c1-3c9ad48d233d None None] MFA Rules not processed for user `a9d8ccb7666c4dec9cdda893b50cdb97`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:19.989682 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f5a490e8-bdb6-4a39-b5c1-3c9ad48d233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:20.069258 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1416/2841] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:20.080355 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1121f-852e-43e9-9cbb-5419ba1a7ae3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:20.082175 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-71f1121f-852e-43e9-9cbb-5419ba1a7ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:20.147792 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1121f-852e-43e9-9cbb-5419ba1a7ae3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:20.152301 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fa280-018f-4a8f-a666-a4e74c0ad16c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:20.153020 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fa280-018f-4a8f-a666-a4e74c0ad16c service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:20.153303 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fa280-018f-4a8f-a666-a4e74c0ad16c service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:20.153582 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fa280-018f-4a8f-a666-a4e74c0ad16c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:20.163204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fa280-018f-4a8f-a666-a4e74c0ad16c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:20.164743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fa280-018f-4a8f-a666-a4e74c0ad16c service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:20.174987 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1426/2842] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:20.332076 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a490e8-bdb6-4a39-b5c1-3c9ad48d233d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:20.412704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a490e8-bdb6-4a39-b5c1-3c9ad48d233d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:20.417476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:20.418313 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:20.418597 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:20.418873 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] PATH_INFO: `/v3/users/496e12b431ce449ab37e977a249a9eb7` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:20.420075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=496e12b431ce449ab37e977a249a9eb7)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:20.422050 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:20.470830 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496e12b431ce449ab37e977a249a9eb7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:20.471477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496e12b431ce449ab37e977a249a9eb7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:20.479758 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496e12b431ce449ab37e977a249a9eb7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:20.487425 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496e12b431ce449ab37e977a249a9eb7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:20.488132 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496e12b431ce449ab37e977a249a9eb7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:20.506349 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1417/2843] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:20 2022] DELETE /identity/v3/users/496e12b431ce449ab37e977a249a9eb7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:20.512190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53697f86-b645-45e1-8b1c-e204f6ae5d60 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:20.512190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53697f86-b645-45e1-8b1c-e204f6ae5d60 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:20.512190 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53697f86-b645-45e1-8b1c-e204f6ae5d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:20.529549 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-53697f86-b645-45e1-8b1c-e204f6ae5d60 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:20.530647 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-53697f86-b645-45e1-8b1c-e204f6ae5d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:20.543364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:20.596873 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1427/2844] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:26:20.615590 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:20.617149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:20.623104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:20.680789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d46a9-4cb7-4e55-bf22-a3a39bcf8f2c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:20.684783 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3332be-ace7-4b9f-99cf-5a5ff95c67da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:20.685445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3332be-ace7-4b9f-99cf-5a5ff95c67da service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:20.685732 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3332be-ace7-4b9f-99cf-5a5ff95c67da service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:20.686001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3332be-ace7-4b9f-99cf-5a5ff95c67da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:20.696319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3332be-ace7-4b9f-99cf-5a5ff95c67da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:20.697834 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3332be-ace7-4b9f-99cf-5a5ff95c67da service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:20.707865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1418/2845] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:21.000557 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53697f86-b645-45e1-8b1c-e204f6ae5d60 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:21.002223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-53697f86-b645-45e1-8b1c-e204f6ae5d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:21.017972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53697f86-b645-45e1-8b1c-e204f6ae5d60 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:21.023385 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:21.025118 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:21.026731 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:21.027243 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] PATH_INFO: `/v3/projects/c048871cbc8745c8bdbb994c4438330d` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:21.029379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c048871cbc8745c8bdbb994c4438330d)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:21.031528 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:21.085101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c048871cbc8745c8bdbb994c4438330d', 'request_id': 'req-794e934b-7ace-42be-9c7a-21f2aa59fa25'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.091223 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c048871cbc8745c8bdbb994c4438330d', 'request_id': 'req-794e934b-7ace-42be-9c7a-21f2aa59fa25'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.100189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c048871cbc8745c8bdbb994c4438330d', 'request_id': 'req-794e934b-7ace-42be-9c7a-21f2aa59fa25'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.117304 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] The token cache is being invalidate because project c048871cbc8745c8bdbb994c4438330d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:21.117646 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.118656 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.120298 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1428/2846] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:20 2022] DELETE /identity/v3/projects/c048871cbc8745c8bdbb994c4438330d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:21.125123 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3332be-ace7-4b9f-99cf-5a5ff95c67da service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:21.135894 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3332be-ace7-4b9f-99cf-5a5ff95c67da service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:21.197487 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:21.198271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:21.198548 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:21.198818 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] PATH_INFO: `/v3/users/a9d8ccb7666c4dec9cdda893b50cdb97` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:21.200055 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d8ccb7666c4dec9cdda893b50cdb97)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:21.202086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:21.257445 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d8ccb7666c4dec9cdda893b50cdb97'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.258218 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d8ccb7666c4dec9cdda893b50cdb97'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.269852 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d8ccb7666c4dec9cdda893b50cdb97'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.278295 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d8ccb7666c4dec9cdda893b50cdb97'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.278958 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5b5e71b1-8c9f-4993-934f-99d7ccafaf4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d8ccb7666c4dec9cdda893b50cdb97'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.299731 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1419/2847] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:21 2022] DELETE /identity/v3/users/a9d8ccb7666c4dec9cdda893b50cdb97 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:21.651830 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:21.653701 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:21.671478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e934b-7ace-42be-9c7a-21f2aa59fa25 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:21.742472 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:21.743439 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:21.743723 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:21.744116 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] PATH_INFO: `/v3/projects/50cfb626631742ada5a0a826c687214f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:21.745474 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cfb626631742ada5a0a826c687214f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:21.747503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:21.796844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:21.800590 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cfb626631742ada5a0a826c687214f', 'request_id': 'req-388bdade-d5e0-4fc1-88ed-139e4c9775b5'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.808921 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cfb626631742ada5a0a826c687214f', 'request_id': 'req-388bdade-d5e0-4fc1-88ed-139e4c9775b5'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.820643 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cfb626631742ada5a0a826c687214f', 'request_id': 'req-388bdade-d5e0-4fc1-88ed-139e4c9775b5'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.833749 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] The token cache is being invalidate because project 50cfb626631742ada5a0a826c687214f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:21.834034 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.834735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-388bdade-d5e0-4fc1-88ed-139e4c9775b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:21.836323 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1429/2848] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:21 2022] DELETE /identity/v3/projects/50cfb626631742ada5a0a826c687214f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:21.841538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f2e52-868d-4391-b2e2-773e17acefa7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:21.841884 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f2e52-868d-4391-b2e2-773e17acefa7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:21.842149 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f2e52-868d-4391-b2e2-773e17acefa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:21.860809 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7f3f2e52-868d-4391-b2e2-773e17acefa7 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:21.862031 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7f3f2e52-868d-4391-b2e2-773e17acefa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:21.881279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:21.928916 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1420/2849] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:21.937597 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef65180-520c-4a10-aea5-74972279346e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:21.937879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef65180-520c-4a10-aea5-74972279346e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:21.938177 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef65180-520c-4a10-aea5-74972279346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:21.959847 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0ef65180-520c-4a10-aea5-74972279346e None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:21.961129 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0ef65180-520c-4a10-aea5-74972279346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:21.970618 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1430/2850] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:21.975628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f2e52-868d-4391-b2e2-773e17acefa7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:21.987018 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f2e52-868d-4391-b2e2-773e17acefa7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:21.993475 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf0bb7-6502-442a-9b9b-e044bd188d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:21.994549 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf0bb7-6502-442a-9b9b-e044bd188d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:21.994874 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf0bb7-6502-442a-9b9b-e044bd188d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:21.995255 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf0bb7-6502-442a-9b9b-e044bd188d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:21.996490 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf0bb7-6502-442a-9b9b-e044bd188d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:21.996885 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf0bb7-6502-442a-9b9b-e044bd188d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:21.999303 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf0bb7-6502-442a-9b9b-e044bd188d46 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:22.013472 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1421/2851] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:22.019033 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef65180-520c-4a10-aea5-74972279346e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:22.028419 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef65180-520c-4a10-aea5-74972279346e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:22.033442 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2ef12-6ffa-4715-9b36-136b647ed790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:22.034105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2ef12-6ffa-4715-9b36-136b647ed790 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.034386 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2ef12-6ffa-4715-9b36-136b647ed790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.034664 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2ef12-6ffa-4715-9b36-136b647ed790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.035373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2ef12-6ffa-4715-9b36-136b647ed790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:22.037329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2ef12-6ffa-4715-9b36-136b647ed790 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:22.070870 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1431/2852] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:22 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:22.072395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf0bb7-6502-442a-9b9b-e044bd188d46 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:22.083769 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf0bb7-6502-442a-9b9b-e044bd188d46 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:22.146842 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408ab27-f6e0-4f13-93be-d222a63dc330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:22.148311 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ab27-f6e0-4f13-93be-d222a63dc330 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.148599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ab27-f6e0-4f13-93be-d222a63dc330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.148909 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ab27-f6e0-4f13-93be-d222a63dc330 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.149625 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408ab27-f6e0-4f13-93be-d222a63dc330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:22.152357 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408ab27-f6e0-4f13-93be-d222a63dc330 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:22.174318 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1422/2853] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:22 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:22.178892 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2ef12-6ffa-4715-9b36-136b647ed790 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:22.193290 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2ef12-6ffa-4715-9b36-136b647ed790 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:22.199380 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e17caf-7625-41a5-9541-6c9fe54524ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:22.200045 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17caf-7625-41a5-9541-6c9fe54524ca admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.200327 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17caf-7625-41a5-9541-6c9fe54524ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.200600 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17caf-7625-41a5-9541-6c9fe54524ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.201379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e17caf-7625-41a5-9541-6c9fe54524ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:22.203435 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e17caf-7625-41a5-9541-6c9fe54524ca admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:22.214578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1432/2854] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:22.218941 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408ab27-f6e0-4f13-93be-d222a63dc330 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:22.230382 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408ab27-f6e0-4f13-93be-d222a63dc330 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:22.239113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884a695-306e-44c5-9bdb-049f04613951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:22.239704 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a695-306e-44c5-9bdb-049f04613951 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.239982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a695-306e-44c5-9bdb-049f04613951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.240252 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a695-306e-44c5-9bdb-049f04613951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.241024 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884a695-306e-44c5-9bdb-049f04613951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:22.242742 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884a695-306e-44c5-9bdb-049f04613951 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:22.254637 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1423/2855] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:22.258972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e17caf-7625-41a5-9541-6c9fe54524ca admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:22.270104 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e17caf-7625-41a5-9541-6c9fe54524ca admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:22.276683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33827045-f139-45df-8f79-0d08331eea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:22.277947 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33827045-f139-45df-8f79-0d08331eea85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.278247 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33827045-f139-45df-8f79-0d08331eea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.278502 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33827045-f139-45df-8f79-0d08331eea85 admin admin] PATH_INFO: `/v3/projects/12cfdeb3f58f421998cb1f48fcba2544/users/903ea366a47e4e74a11aae66cfb09935/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.294403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33827045-f139-45df-8f79-0d08331eea85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cfdeb3f58f421998cb1f48fcba2544, user_id=903ea366a47e4e74a11aae66cfb09935, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:22.297572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33827045-f139-45df-8f79-0d08331eea85 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:22.311691 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1433/2856] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:22 2022] PUT /identity/v3/projects/12cfdeb3f58f421998cb1f48fcba2544/users/903ea366a47e4e74a11aae66cfb09935/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:22.322956 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84217-3c5b-4f79-95b7-40c0c5b62ab6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.323242 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84217-3c5b-4f79-95b7-40c0c5b62ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.323516 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84217-3c5b-4f79-95b7-40c0c5b62ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.352430 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a1f84217-3c5b-4f79-95b7-40c0c5b62ab6 None None] MFA Rules not processed for user `903ea366a47e4e74a11aae66cfb09935`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:22.353664 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a1f84217-3c5b-4f79-95b7-40c0c5b62ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:22.427171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1424/2857] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:22.439227 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33827045-f139-45df-8f79-0d08331eea85 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:22.441191 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-33827045-f139-45df-8f79-0d08331eea85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:22.504362 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33827045-f139-45df-8f79-0d08331eea85 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:22.508379 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f8a9-8a18-4cb7-8c97-9168361a5176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:22.509077 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f8a9-8a18-4cb7-8c97-9168361a5176 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.509365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f8a9-8a18-4cb7-8c97-9168361a5176 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.509695 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f8a9-8a18-4cb7-8c97-9168361a5176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.518761 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304f8a9-8a18-4cb7-8c97-9168361a5176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:22.520222 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304f8a9-8a18-4cb7-8c97-9168361a5176 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:22.531513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1434/2858] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:25.685161 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84217-3c5b-4f79-95b7-40c0c5b62ab6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:25.709561 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:25.810317 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84217-3c5b-4f79-95b7-40c0c5b62ab6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:25.816209 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:25.817285 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:25.817638 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:25.817937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] PATH_INFO: `/v3/users/903ea366a47e4e74a11aae66cfb09935` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:25.819439 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=903ea366a47e4e74a11aae66cfb09935)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:25.821612 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:25.880969 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903ea366a47e4e74a11aae66cfb09935'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:25.881850 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903ea366a47e4e74a11aae66cfb09935'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:25.891460 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903ea366a47e4e74a11aae66cfb09935'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:25.902902 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903ea366a47e4e74a11aae66cfb09935'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:25.904005 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903ea366a47e4e74a11aae66cfb09935'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:25.922146 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1425/2859] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:25 2022] DELETE /identity/v3/users/903ea366a47e4e74a11aae66cfb09935 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:25.928000 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1218-f71e-44ef-af18-6bc4149e4952 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:25.928561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1218-f71e-44ef-af18-6bc4149e4952 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:25.928561 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1218-f71e-44ef-af18-6bc4149e4952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:25.979945 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7fce1218-f71e-44ef-af18-6bc4149e4952 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:25.981565 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7fce1218-f71e-44ef-af18-6bc4149e4952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:26.024024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:26.048468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1435/2860] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:26.058482 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:26.060118 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:26.125184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:26.141616 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495a1a3-2e28-49dd-bfc7-c45f029af969 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:26.146254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bba8b-d74b-4044-aae1-3bc737e97735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:26.146942 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bba8b-d74b-4044-aae1-3bc737e97735 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:26.147212 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bba8b-d74b-4044-aae1-3bc737e97735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:26.147481 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bba8b-d74b-4044-aae1-3bc737e97735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:26.157774 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bba8b-d74b-4044-aae1-3bc737e97735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:26.159381 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bba8b-d74b-4044-aae1-3bc737e97735 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:26.168938 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1426/2861] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:26.475495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1218-f71e-44ef-af18-6bc4149e4952 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:26.477101 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7fce1218-f71e-44ef-af18-6bc4149e4952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:26.490180 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1218-f71e-44ef-af18-6bc4149e4952 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:26.495543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:26.496438 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:26.496743 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:26.497021 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] PATH_INFO: `/v3/projects/12cfdeb3f58f421998cb1f48fcba2544` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:26.498503 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12cfdeb3f58f421998cb1f48fcba2544)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:26.500369 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:26.552902 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12cfdeb3f58f421998cb1f48fcba2544', 'request_id': 'req-a0563278-e228-4ee7-8b75-bbce9b69fb38'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:26.561403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12cfdeb3f58f421998cb1f48fcba2544', 'request_id': 'req-a0563278-e228-4ee7-8b75-bbce9b69fb38'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:26.570539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12cfdeb3f58f421998cb1f48fcba2544', 'request_id': 'req-a0563278-e228-4ee7-8b75-bbce9b69fb38'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:26.581970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] The token cache is being invalidate because project 12cfdeb3f58f421998cb1f48fcba2544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:26.582256 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:26.582917 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:26.584534 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1436/2862] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:26 2022] DELETE /identity/v3/projects/12cfdeb3f58f421998cb1f48fcba2544 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:36.164828 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=7 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:36.579105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:37.236940 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bba8b-d74b-4044-aae1-3bc737e97735 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:37.238466 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-629bba8b-d74b-4044-aae1-3bc737e97735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:37.255104 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bba8b-d74b-4044-aae1-3bc737e97735 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:37.315846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:37.316680 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:37.316966 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:37.317240 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] PATH_INFO: `/v3/users/41dad262dbba4f62ab74ad331195c760` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:37.318557 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41dad262dbba4f62ab74ad331195c760)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:37.320495 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:37.375019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41dad262dbba4f62ab74ad331195c760'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.375676 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41dad262dbba4f62ab74ad331195c760'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.385424 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41dad262dbba4f62ab74ad331195c760'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.393142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41dad262dbba4f62ab74ad331195c760'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.393827 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41dad262dbba4f62ab74ad331195c760'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.411393 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1427/2863] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:37 2022] DELETE /identity/v3/users/41dad262dbba4f62ab74ad331195c760 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:37.591468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:37.593112 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:37.608105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0563278-e228-4ee7-8b75-bbce9b69fb38 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:37.669055 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:37.670098 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:37.670376 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:37.670648 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] PATH_INFO: `/v3/projects/a72ec7b9e86245a79e8ccb29a9fd9ce9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:37.671837 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72ec7b9e86245a79e8ccb29a9fd9ce9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:37.673767 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:37.721672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72ec7b9e86245a79e8ccb29a9fd9ce9', 'request_id': 'req-3e356619-4c6b-48d9-8564-b5292681ac28'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.726967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72ec7b9e86245a79e8ccb29a9fd9ce9', 'request_id': 'req-3e356619-4c6b-48d9-8564-b5292681ac28'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.735373 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72ec7b9e86245a79e8ccb29a9fd9ce9', 'request_id': 'req-3e356619-4c6b-48d9-8564-b5292681ac28'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.747300 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] The token cache is being invalidate because project a72ec7b9e86245a79e8ccb29a9fd9ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:37.747595 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.748311 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.749960 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1437/2864] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:37 2022] DELETE /identity/v3/projects/a72ec7b9e86245a79e8ccb29a9fd9ce9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:37.754015 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:37.755538 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:37.770152 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ce7b2-ba19-48df-8274-4e843d34ec50 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:37.831293 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:37.832086 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:37.832399 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:37.832684 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] PATH_INFO: `/v3/users/a81c4602aaff4107a953848b4a082419` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:37.833982 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81c4602aaff4107a953848b4a082419)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:37.835917 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:37.857935 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:37.891952 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81c4602aaff4107a953848b4a082419'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.893042 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81c4602aaff4107a953848b4a082419'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.904973 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81c4602aaff4107a953848b4a082419'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.911877 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81c4602aaff4107a953848b4a082419'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.912531 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-66789b51-8e08-479f-a6b0-6653a6aacc68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81c4602aaff4107a953848b4a082419'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:37.929879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1428/2865] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:37 2022] DELETE /identity/v3/users/a81c4602aaff4107a953848b4a082419 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:38.112940 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:38.114483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:38.127206 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e356619-4c6b-48d9-8564-b5292681ac28 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:38.190878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:38.191770 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.192038 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.192309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] PATH_INFO: `/v3/projects/0b5df002f1ff4169ae7574e61935aa85` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.193588 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5df002f1ff4169ae7574e61935aa85)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:38.195481 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:38.234478 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:38.248943 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5df002f1ff4169ae7574e61935aa85', 'request_id': 'req-d84e957e-354d-4a0f-8abc-0089054a46b9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:38.256931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5df002f1ff4169ae7574e61935aa85', 'request_id': 'req-d84e957e-354d-4a0f-8abc-0089054a46b9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:38.266822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5df002f1ff4169ae7574e61935aa85', 'request_id': 'req-d84e957e-354d-4a0f-8abc-0089054a46b9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:38.281240 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] The token cache is being invalidate because project 0b5df002f1ff4169ae7574e61935aa85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:38.281821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:38.282495 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d84e957e-354d-4a0f-8abc-0089054a46b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:38.287578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1438/2866] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:38 2022] DELETE /identity/v3/projects/0b5df002f1ff4169ae7574e61935aa85 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:38.289359 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2435-96e4-496a-bda5-876345bb523a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.289823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2435-96e4-496a-bda5-876345bb523a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.289921 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2435-96e4-496a-bda5-876345bb523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.346046 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-85fa2435-96e4-496a-bda5-876345bb523a None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:38.347267 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-85fa2435-96e4-496a-bda5-876345bb523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:38.426702 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1429/2867] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:38.435273 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4275dcd-2367-474c-88a5-017d4921fa22 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.435574 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4275dcd-2367-474c-88a5-017d4921fa22 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.435860 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4275dcd-2367-474c-88a5-017d4921fa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.455828 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d4275dcd-2367-474c-88a5-017d4921fa22 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:38.457076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d4275dcd-2367-474c-88a5-017d4921fa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:38.465359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1439/2868] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:38.469836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa2435-96e4-496a-bda5-876345bb523a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:38.479629 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa2435-96e4-496a-bda5-876345bb523a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:38.485201 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c52df-802e-4bdc-a305-ea2c88693fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:38.485967 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c52df-802e-4bdc-a305-ea2c88693fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.486310 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c52df-802e-4bdc-a305-ea2c88693fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.486649 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c52df-802e-4bdc-a305-ea2c88693fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.487470 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c52df-802e-4bdc-a305-ea2c88693fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:38.487841 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c52df-802e-4bdc-a305-ea2c88693fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:38.489617 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c52df-802e-4bdc-a305-ea2c88693fb1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:38.502600 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1430/2869] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:38.507100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4275dcd-2367-474c-88a5-017d4921fa22 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:38.516976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4275dcd-2367-474c-88a5-017d4921fa22 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:38.521984 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fda282-b806-42c4-8832-d12ab3da1979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:38.522654 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fda282-b806-42c4-8832-d12ab3da1979 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.522933 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fda282-b806-42c4-8832-d12ab3da1979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.523207 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fda282-b806-42c4-8832-d12ab3da1979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.523909 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fda282-b806-42c4-8832-d12ab3da1979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:38.525833 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fda282-b806-42c4-8832-d12ab3da1979 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:38.553504 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1440/2870] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:38 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:38.557922 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c52df-802e-4bdc-a305-ea2c88693fb1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:38.568231 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c52df-802e-4bdc-a305-ea2c88693fb1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:38.626899 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c71c60-bc33-4a47-a539-d6b8f62ff531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:38.627506 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71c60-bc33-4a47-a539-d6b8f62ff531 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.627794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71c60-bc33-4a47-a539-d6b8f62ff531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.628077 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71c60-bc33-4a47-a539-d6b8f62ff531 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.628823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c71c60-bc33-4a47-a539-d6b8f62ff531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:38.630750 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c71c60-bc33-4a47-a539-d6b8f62ff531 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:38.638668 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:38.655726 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1431/2871] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:38 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:38.660044 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fda282-b806-42c4-8832-d12ab3da1979 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:38.670901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fda282-b806-42c4-8832-d12ab3da1979 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:38.676579 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f072a-76b0-42b6-8410-74423fe52c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:38.677644 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f072a-76b0-42b6-8410-74423fe52c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.677791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f072a-76b0-42b6-8410-74423fe52c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.678052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f072a-76b0-42b6-8410-74423fe52c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.678846 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f072a-76b0-42b6-8410-74423fe52c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:38.680405 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f072a-76b0-42b6-8410-74423fe52c74 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:38.691982 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1441/2872] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:38.696892 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c71c60-bc33-4a47-a539-d6b8f62ff531 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:38.712115 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c71c60-bc33-4a47-a539-d6b8f62ff531 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:38.719833 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c7c3b-df45-4db9-9448-c601b559ed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:38.720498 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c7c3b-df45-4db9-9448-c601b559ed18 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.720871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c7c3b-df45-4db9-9448-c601b559ed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.721146 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c7c3b-df45-4db9-9448-c601b559ed18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.721871 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c7c3b-df45-4db9-9448-c601b559ed18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:38.723473 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c7c3b-df45-4db9-9448-c601b559ed18 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:38.735515 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1432/2873] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:26:38.740813 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f072a-76b0-42b6-8410-74423fe52c74 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:38.754182 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f072a-76b0-42b6-8410-74423fe52c74 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:38.760103 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47723dc4-39b3-46e5-9952-dd2b480c400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:38.761060 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723dc4-39b3-46e5-9952-dd2b480c400e admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.761347 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723dc4-39b3-46e5-9952-dd2b480c400e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.761623 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723dc4-39b3-46e5-9952-dd2b480c400e admin admin] PATH_INFO: `/v3/projects/d100b43c868047d5a5025a8761fd7196/users/b8324fa660824a83aa1f3bbfc5af30d0/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.778192 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47723dc4-39b3-46e5-9952-dd2b480c400e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d100b43c868047d5a5025a8761fd7196, user_id=b8324fa660824a83aa1f3bbfc5af30d0, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:38.781051 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47723dc4-39b3-46e5-9952-dd2b480c400e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:38.795266 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1442/2874] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:38 2022] PUT /identity/v3/projects/d100b43c868047d5a5025a8761fd7196/users/b8324fa660824a83aa1f3bbfc5af30d0/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:38.805777 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53405b4-5c6a-49e7-a9a1-de2e8289adf5 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.806035 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53405b4-5c6a-49e7-a9a1-de2e8289adf5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.806319 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53405b4-5c6a-49e7-a9a1-de2e8289adf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.833631 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d53405b4-5c6a-49e7-a9a1-de2e8289adf5 None None] MFA Rules not processed for user `b8324fa660824a83aa1f3bbfc5af30d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:38.834832 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d53405b4-5c6a-49e7-a9a1-de2e8289adf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:38.903554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1433/2875] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:38.915081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47723dc4-39b3-46e5-9952-dd2b480c400e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:38.917146 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-47723dc4-39b3-46e5-9952-dd2b480c400e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:38.984216 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47723dc4-39b3-46e5-9952-dd2b480c400e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:38.988879 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c6507-7715-40df-8a29-5edc210f1695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:38.989558 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c6507-7715-40df-8a29-5edc210f1695 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.989850 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c6507-7715-40df-8a29-5edc210f1695 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.990124 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c6507-7715-40df-8a29-5edc210f1695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:39.000336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c6507-7715-40df-8a29-5edc210f1695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:39.001814 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c6507-7715-40df-8a29-5edc210f1695 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:39.011510 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1443/2876] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:42.131746 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53405b4-5c6a-49e7-a9a1-de2e8289adf5 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:42.134277 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d53405b4-5c6a-49e7-a9a1-de2e8289adf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:42.227784 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53405b4-5c6a-49e7-a9a1-de2e8289adf5 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:42.232859 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb3927-fff7-47c4-8312-99b275ff9b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:42.233511 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb3927-fff7-47c4-8312-99b275ff9b84 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:42.233793 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb3927-fff7-47c4-8312-99b275ff9b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:42.234075 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb3927-fff7-47c4-8312-99b275ff9b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:42.236192 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0edb3927-fff7-47c4-8312-99b275ff9b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:42.302477 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb3927-fff7-47c4-8312-99b275ff9b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:42.304102 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb3927-fff7-47c4-8312-99b275ff9b84 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:42.309391 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:42.314937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1434/2877] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:44.046615 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c6507-7715-40df-8a29-5edc210f1695 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:44.048125 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fd7c6507-7715-40df-8a29-5edc210f1695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:44.136071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:44.192448 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c6507-7715-40df-8a29-5edc210f1695 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:44.197416 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad6001-3135-4ac0-97a6-77598a0f556e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:44.198137 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad6001-3135-4ac0-97a6-77598a0f556e service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:44.198513 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad6001-3135-4ac0-97a6-77598a0f556e service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:44.198821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad6001-3135-4ac0-97a6-77598a0f556e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:44.201276 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6fad6001-3135-4ac0-97a6-77598a0f556e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:44.217061 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad6001-3135-4ac0-97a6-77598a0f556e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:44.218735 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad6001-3135-4ac0-97a6-77598a0f556e service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:44.232262 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1444/2878] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:50.728529 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb3927-fff7-47c4-8312-99b275ff9b84 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:50.797286 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb3927-fff7-47c4-8312-99b275ff9b84 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:50.802599 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:50.803530 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:50.803815 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:50.804090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] PATH_INFO: `/v3/users/b8324fa660824a83aa1f3bbfc5af30d0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:50.805438 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8324fa660824a83aa1f3bbfc5af30d0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:50.807428 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:50.860534 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8324fa660824a83aa1f3bbfc5af30d0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:50.861241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8324fa660824a83aa1f3bbfc5af30d0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:50.877655 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8324fa660824a83aa1f3bbfc5af30d0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:50.886002 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8324fa660824a83aa1f3bbfc5af30d0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:50.886601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8324fa660824a83aa1f3bbfc5af30d0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:50.905176 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1435/2879] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:50 2022] DELETE /identity/v3/users/b8324fa660824a83aa1f3bbfc5af30d0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:50.910126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f701b2-4fb3-4963-9fd2-d289539a9fae None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:50.910670 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f701b2-4fb3-4963-9fd2-d289539a9fae None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:50.910867 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f701b2-4fb3-4963-9fd2-d289539a9fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:50.929970 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-89f701b2-4fb3-4963-9fd2-d289539a9fae None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:50.931189 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-89f701b2-4fb3-4963-9fd2-d289539a9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:51.003593 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1445/2880] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:51.014766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:51.016398 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:51.075001 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec1154-33b2-4b4d-9d45-9922672c8d0f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:51.079008 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bce67d-53af-4203-b0c1-57d4f282daee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:51.079658 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce67d-53af-4203-b0c1-57d4f282daee service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:51.079937 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce67d-53af-4203-b0c1-57d4f282daee service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:51.080210 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce67d-53af-4203-b0c1-57d4f282daee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:51.096376 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bce67d-53af-4203-b0c1-57d4f282daee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:51.098596 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bce67d-53af-4203-b0c1-57d4f282daee service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:51.108511 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1436/2881] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:51.399972 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f701b2-4fb3-4963-9fd2-d289539a9fae None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:51.401468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-89f701b2-4fb3-4963-9fd2-d289539a9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:51.414868 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f701b2-4fb3-4963-9fd2-d289539a9fae None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:51.420294 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:51.421791 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:51.422086 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:51.422539 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] PATH_INFO: `/v3/projects/d100b43c868047d5a5025a8761fd7196` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:51.423793 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d100b43c868047d5a5025a8761fd7196)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:51.426507 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:51.486165 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd100b43c868047d5a5025a8761fd7196', 'request_id': 'req-138f4a8b-3379-41eb-a763-46231c27bf73'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:51.492639 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd100b43c868047d5a5025a8761fd7196', 'request_id': 'req-138f4a8b-3379-41eb-a763-46231c27bf73'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:51.503827 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd100b43c868047d5a5025a8761fd7196', 'request_id': 'req-138f4a8b-3379-41eb-a763-46231c27bf73'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:51.520627 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] The token cache is being invalidate because project d100b43c868047d5a5025a8761fd7196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:51.520930 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:51.521637 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-138f4a8b-3379-41eb-a763-46231c27bf73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:51.523155 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1446/2882] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:51 2022] DELETE /identity/v3/projects/d100b43c868047d5a5025a8761fd7196 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:51.529301 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d81c-7683-4ac0-ac5f-fd2e58baf723 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:51.529764 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d81c-7683-4ac0-ac5f-fd2e58baf723 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:51.530068 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d81c-7683-4ac0-ac5f-fd2e58baf723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:51.552927 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-56a9d81c-7683-4ac0-ac5f-fd2e58baf723 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:51.554262 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-56a9d81c-7683-4ac0-ac5f-fd2e58baf723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:51.574090 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:51.619888 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1437/2883] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:51.628195 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fcf4-6dee-4f63-91a1-c6b6044fb513 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:51.628924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fcf4-6dee-4f63-91a1-c6b6044fb513 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:51.628924 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fcf4-6dee-4f63-91a1-c6b6044fb513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:51.650672 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f5f6fcf4-6dee-4f63-91a1-c6b6044fb513 None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:51.651901 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f5f6fcf4-6dee-4f63-91a1-c6b6044fb513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:51.661552 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1447/2884] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:51.666390 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9d81c-7683-4ac0-ac5f-fd2e58baf723 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:51.677083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9d81c-7683-4ac0-ac5f-fd2e58baf723 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:51.682117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7697bf-f9f2-4e30-8cee-e7d818ad4bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:51.682794 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7697bf-f9f2-4e30-8cee-e7d818ad4bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:51.683081 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7697bf-f9f2-4e30-8cee-e7d818ad4bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:51.683360 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7697bf-f9f2-4e30-8cee-e7d818ad4bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:51.684119 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7697bf-f9f2-4e30-8cee-e7d818ad4bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:51.684479 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7697bf-f9f2-4e30-8cee-e7d818ad4bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:51.686185 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7697bf-f9f2-4e30-8cee-e7d818ad4bd9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:51.700721 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1438/2885] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jul 14 09:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:26:51.708397 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6fcf4-6dee-4f63-91a1-c6b6044fb513 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:51.722599 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6fcf4-6dee-4f63-91a1-c6b6044fb513 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:51.727572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5f8a4-0e95-473a-bc30-297876a78501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:51.728284 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5f8a4-0e95-473a-bc30-297876a78501 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:51.728572 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5f8a4-0e95-473a-bc30-297876a78501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:51.728877 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5f8a4-0e95-473a-bc30-297876a78501 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:51.729601 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5f8a4-0e95-473a-bc30-297876a78501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:51.732907 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5f8a4-0e95-473a-bc30-297876a78501 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:51.764062 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1448/2886] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jul 14 09:26:51 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:51.770632 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7697bf-f9f2-4e30-8cee-e7d818ad4bd9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:51.781961 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7697bf-f9f2-4e30-8cee-e7d818ad4bd9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:51.847094 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383901eb-d27d-4d27-b5a8-5636579d6640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:51.847811 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383901eb-d27d-4d27-b5a8-5636579d6640 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:51.848013 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383901eb-d27d-4d27-b5a8-5636579d6640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:51.848296 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383901eb-d27d-4d27-b5a8-5636579d6640 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:51.849067 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383901eb-d27d-4d27-b5a8-5636579d6640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:51.851059 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383901eb-d27d-4d27-b5a8-5636579d6640 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:51.878205 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1439/2887] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jul 14 09:26:51 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:51.883030 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5f8a4-0e95-473a-bc30-297876a78501 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:51.900183 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5f8a4-0e95-473a-bc30-297876a78501 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:51.908483 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8561fe-5f2a-474e-8279-aabcb19bc541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:51.909538 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8561fe-5f2a-474e-8279-aabcb19bc541 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:51.909864 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8561fe-5f2a-474e-8279-aabcb19bc541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:51.910100 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8561fe-5f2a-474e-8279-aabcb19bc541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:51.910852 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8561fe-5f2a-474e-8279-aabcb19bc541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:51.912506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8561fe-5f2a-474e-8279-aabcb19bc541 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:51.927081 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1449/2888] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:51.932849 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383901eb-d27d-4d27-b5a8-5636579d6640 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:51.946836 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383901eb-d27d-4d27-b5a8-5636579d6640 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:51.952279 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e61df-15df-41e5-95f7-ec00856d85ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:51.953082 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e61df-15df-41e5-95f7-ec00856d85ce admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:51.953368 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e61df-15df-41e5-95f7-ec00856d85ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:51.953646 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e61df-15df-41e5-95f7-ec00856d85ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:51.954406 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e61df-15df-41e5-95f7-ec00856d85ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:51.956370 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e61df-15df-41e5-95f7-ec00856d85ce admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:51.968087 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1440/2889] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jul 14 09:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:26:51.972821 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8561fe-5f2a-474e-8279-aabcb19bc541 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:51.980543 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:51.989578 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8561fe-5f2a-474e-8279-aabcb19bc541 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:51.996822 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9a539-bbac-411a-8b30-5f686744a947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:51.997878 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9a539-bbac-411a-8b30-5f686744a947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:51.998200 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9a539-bbac-411a-8b30-5f686744a947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:51.998514 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9a539-bbac-411a-8b30-5f686744a947 admin admin] PATH_INFO: `/v3/projects/592bd5b65c30440ca521825362b6f52b/users/3fb32fef1ad94043a5204531470484a6/roles/1790dd5eeda1419ca41830c6448c63fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:52.015757 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9a539-bbac-411a-8b30-5f686744a947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592bd5b65c30440ca521825362b6f52b, user_id=3fb32fef1ad94043a5204531470484a6, role_id=1790dd5eeda1419ca41830c6448c63fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:52.018460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9a539-bbac-411a-8b30-5f686744a947 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:52.033485 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1450/2890] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jul 14 09:26:51 2022] PUT /identity/v3/projects/592bd5b65c30440ca521825362b6f52b/users/3fb32fef1ad94043a5204531470484a6/roles/1790dd5eeda1419ca41830c6448c63fe => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:52.109641 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8b3f-854d-444e-b4eb-48ff0cdcf068 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:52.109924 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8b3f-854d-444e-b4eb-48ff0cdcf068 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:52.110241 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8b3f-854d-444e-b4eb-48ff0cdcf068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:52.145601 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-35cd8b3f-854d-444e-b4eb-48ff0cdcf068 None None] MFA Rules not processed for user `3fb32fef1ad94043a5204531470484a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:52.146948 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-35cd8b3f-854d-444e-b4eb-48ff0cdcf068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:52.218466 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1441/2891] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:52.231058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9a539-bbac-411a-8b30-5f686744a947 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:52.233024 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d4d9a539-bbac-411a-8b30-5f686744a947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:52.322976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9a539-bbac-411a-8b30-5f686744a947 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:52.326931 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aef305-34f0-44cc-bdac-70facebd2fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9b12f6e7e347e19e5183d7e45b162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:52.327838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef305-34f0-44cc-bdac-70facebd2fcf service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:52.328186 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef305-34f0-44cc-bdac-70facebd2fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:52.328465 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef305-34f0-44cc-bdac-70facebd2fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:52.339056 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aef305-34f0-44cc-bdac-70facebd2fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:52.340755 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aef305-34f0-44cc-bdac-70facebd2fcf service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:52.352071 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1451/2892] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:54.949915 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8b3f-854d-444e-b4eb-48ff0cdcf068 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:54.970072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:55.021581 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8b3f-854d-444e-b4eb-48ff0cdcf068 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:55.029273 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:55.030509 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:55.030901 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:55.031377 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] PATH_INFO: `/v3/users/3fb32fef1ad94043a5204531470484a6` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:55.033324 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb32fef1ad94043a5204531470484a6)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:55.035687 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:55.095189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb32fef1ad94043a5204531470484a6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:55.096189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb32fef1ad94043a5204531470484a6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:55.109117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb32fef1ad94043a5204531470484a6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:55.117724 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb32fef1ad94043a5204531470484a6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:55.118539 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb32fef1ad94043a5204531470484a6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:55.137839 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1442/2893] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:26:54 2022] DELETE /identity/v3/users/3fb32fef1ad94043a5204531470484a6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:55.142997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd5b86-6911-45f4-9218-95fecb7754fd None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:55.143685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd5b86-6911-45f4-9218-95fecb7754fd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:55.143685 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd5b86-6911-45f4-9218-95fecb7754fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:55.162951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b9dd5b86-6911-45f4-9218-95fecb7754fd None None] MFA Rules not processed for user `ed59d5d85ac94b5e83056380d59a4958`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:55.164282 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b9dd5b86-6911-45f4-9218-95fecb7754fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:55.228533 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1452/2894] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jul 14 09:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:26:55.240823 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:55.242628 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:55.304339 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d716b9a-61cb-42e6-9c92-fe66dac36e97 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:55.308504 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9b655-a107-4b18-99ea-4df1a3743e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:55.309191 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9b655-a107-4b18-99ea-4df1a3743e41 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:55.309476 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9b655-a107-4b18-99ea-4df1a3743e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:55.309752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9b655-a107-4b18-99ea-4df1a3743e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:55.319890 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9b655-a107-4b18-99ea-4df1a3743e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:55.322052 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9b655-a107-4b18-99ea-4df1a3743e41 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:55.334857 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1443/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:26:55.619350 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd5b86-6911-45f4-9218-95fecb7754fd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:55.621058 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b9dd5b86-6911-45f4-9218-95fecb7754fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:55.635390 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd5b86-6911-45f4-9218-95fecb7754fd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:55.641469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:55.642385 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:55.642663 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:55.642934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] PATH_INFO: `/v3/projects/592bd5b65c30440ca521825362b6f52b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:55.644413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=592bd5b65c30440ca521825362b6f52b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:55.647425 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:55.696776 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592bd5b65c30440ca521825362b6f52b', 'request_id': 'req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:55.701148 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:55.702460 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592bd5b65c30440ca521825362b6f52b', 'request_id': 'req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:55.709844 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592bd5b65c30440ca521825362b6f52b', 'request_id': 'req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:55.721403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] The token cache is being invalidate because project 592bd5b65c30440ca521825362b6f52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:26:55.721709 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:55.722332 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:26:55.723926 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1453/2896] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:26:55 2022] DELETE /identity/v3/projects/592bd5b65c30440ca521825362b6f52b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:27:05.330006 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:05.718630 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:29.318379 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9b655-a107-4b18-99ea-4df1a3743e41 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:29.320463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a8c9b655-a107-4b18-99ea-4df1a3743e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:27:29.425554 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9b655-a107-4b18-99ea-4df1a3743e41 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:29.501165 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac1a0-1ab0-43fa-bdbd-8b24dbd142cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:29.501865 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac1a0-1ab0-43fa-bdbd-8b24dbd142cb service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:29.502142 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac1a0-1ab0-43fa-bdbd-8b24dbd142cb service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:29.502412 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac1a0-1ab0-43fa-bdbd-8b24dbd142cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:29.504407 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-508ac1a0-1ab0-43fa-bdbd-8b24dbd142cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:27:29.516422 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ac1a0-1ab0-43fa-bdbd-8b24dbd142cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:29.518057 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ac1a0-1ab0-43fa-bdbd-8b24dbd142cb service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:29.528189 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1444/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:27:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:27:39.524148 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=67 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:38.856364 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:38.858523 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:38.931807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad16d1-ee8b-4fb3-ae58-2596f7ee7cbb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:38.936000 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e60a7-0a6d-475b-a107-aa49580e8530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:38.936652 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e60a7-0a6d-475b-a107-aa49580e8530 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:38.936963 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e60a7-0a6d-475b-a107-aa49580e8530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:38.937231 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e60a7-0a6d-475b-a107-aa49580e8530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:38.939309 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-631e60a7-0a6d-475b-a107-aa49580e8530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:39.018270 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e60a7-0a6d-475b-a107-aa49580e8530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:39.019706 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e60a7-0a6d-475b-a107-aa49580e8530 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:39.030958 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1454/2898] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:28:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:28:40.235560 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac1a0-1ab0-43fa-bdbd-8b24dbd142cb service placement] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:40.246193 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac1a0-1ab0-43fa-bdbd-8b24dbd142cb service placement] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:40.250845 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8a383-2e36-4a3d-baf1-e9765d6a2849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:40.251533 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8a383-2e36-4a3d-baf1-e9765d6a2849 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:40.251851 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8a383-2e36-4a3d-baf1-e9765d6a2849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:40.252246 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8a383-2e36-4a3d-baf1-e9765d6a2849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:40.254280 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-48c8a383-2e36-4a3d-baf1-e9765d6a2849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:40.272588 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8a383-2e36-4a3d-baf1-e9765d6a2849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:40.274431 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8a383-2e36-4a3d-baf1-e9765d6a2849 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:40.285860 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1445/2899] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:28:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:28:49.026228 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=54 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:50.280931 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=6 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:52.412321 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720b528-e5b5-4c7f-9dc5-4e07c6f43ef9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:52.412976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720b528-e5b5-4c7f-9dc5-4e07c6f43ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:52.412976 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720b528-e5b5-4c7f-9dc5-4e07c6f43ef9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:52.414455 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1455/2900] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:28:52.420786 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb030f1-5d4b-4b5c-9700-dcaea0f7a481 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:52.421306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb030f1-5d4b-4b5c-9700-dcaea0f7a481 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:52.421306 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb030f1-5d4b-4b5c-9700-dcaea0f7a481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:52.471171 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2cb030f1-5d4b-4b5c-9700-dcaea0f7a481 None None] MFA Rules not processed for user `60db5d8bc4cb4ce7af8bfac2c4eb2390`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:28:52.472392 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2cb030f1-5d4b-4b5c-9700-dcaea0f7a481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:52.479270 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1446/2901] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:28:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:28:52.495108 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720b528-e5b5-4c7f-9dc5-4e07c6f43ef9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:52.496928 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2720b528-e5b5-4c7f-9dc5-4e07c6f43ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:52.510559 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720b528-e5b5-4c7f-9dc5-4e07c6f43ef9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:52.514105 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a5887-822d-4b8d-ae78-8fea579ad61a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:52.514796 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5887-822d-4b8d-ae78-8fea579ad61a service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:52.515076 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5887-822d-4b8d-ae78-8fea579ad61a service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:52.515318 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5887-822d-4b8d-ae78-8fea579ad61a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:52.523544 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a5887-822d-4b8d-ae78-8fea579ad61a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:52.525269 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a5887-822d-4b8d-ae78-8fea579ad61a service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:52.534047 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1456/2902] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:28:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:28:52.635113 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3fea8-70f5-4a2a-b9de-668bbabe44cd None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:52.635449 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3fea8-70f5-4a2a-b9de-668bbabe44cd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:52.635844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3fea8-70f5-4a2a-b9de-668bbabe44cd None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:52.638088 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1447/2903] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jul 14 09:28:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:28:52.646570 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719bf46-e375-4f71-bf2d-b89ed7ecc62e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:52.646991 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719bf46-e375-4f71-bf2d-b89ed7ecc62e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:52.647365 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719bf46-e375-4f71-bf2d-b89ed7ecc62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:52.687807 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c719bf46-e375-4f71-bf2d-b89ed7ecc62e None None] MFA Rules not processed for user `66f1d95bcc534f4e945fc2c5be046a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:28:52.689066 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c719bf46-e375-4f71-bf2d-b89ed7ecc62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:52.699843 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1457/2904] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jul 14 09:28:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:28:52.711136 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3fea8-70f5-4a2a-b9de-668bbabe44cd None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:52.724464 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3fea8-70f5-4a2a-b9de-668bbabe44cd None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:52.729062 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d28d9a-2645-4bec-9676-27142fb671f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:52.729707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d28d9a-2645-4bec-9676-27142fb671f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:52.729991 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d28d9a-2645-4bec-9676-27142fb671f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:52.730272 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d28d9a-2645-4bec-9676-27142fb671f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:52.740844 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d28d9a-2645-4bec-9676-27142fb671f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:52.742344 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d28d9a-2645-4bec-9676-27142fb671f4 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:52.753322 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1448/2905] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:28:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:02.685506 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=15 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:02.748707 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=19 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:36.975182 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719bf46-e375-4f71-bf2d-b89ed7ecc62e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:36.989740 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719bf46-e375-4f71-bf2d-b89ed7ecc62e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:36.995468 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78317a86-4d90-42a4-9a32-cdaae7943d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60db5d8bc4cb4ce7af8bfac2c4eb2390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:36.996122 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317a86-4d90-42a4-9a32-cdaae7943d56 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:36.996429 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317a86-4d90-42a4-9a32-cdaae7943d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:36.996698 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317a86-4d90-42a4-9a32-cdaae7943d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:36.999133 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-78317a86-4d90-42a4-9a32-cdaae7943d56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:37.010244 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78317a86-4d90-42a4-9a32-cdaae7943d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:37.011728 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78317a86-4d90-42a4-9a32-cdaae7943d56 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:37.020908 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1458/2906] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:47.016444 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:08.678184 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d28d9a-2645-4bec-9676-27142fb671f4 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:08.679821 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-08d28d9a-2645-4bec-9676-27142fb671f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:08.704103 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d28d9a-2645-4bec-9676-27142fb671f4 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:08.710766 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0230f5-f30f-4d7c-80ce-f2a4c3677784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f1d95bcc534f4e945fc2c5be046a5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:08.711694 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0230f5-f30f-4d7c-80ce-f2a4c3677784 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:08.712022 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0230f5-f30f-4d7c-80ce-f2a4c3677784 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:08.712328 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0230f5-f30f-4d7c-80ce-f2a4c3677784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:08.715271 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cc0230f5-f30f-4d7c-80ce-f2a4c3677784 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:08.731525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0230f5-f30f-4d7c-80ce-f2a4c3677784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:08.733154 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0230f5-f30f-4d7c-80ce-f2a4c3677784 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:08.748965 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1449/2907] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:18.740345 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=6 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:19.016359 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78317a86-4d90-42a4-9a32-cdaae7943d56 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:19.017934 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-78317a86-4d90-42a4-9a32-cdaae7943d56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:19.034018 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78317a86-4d90-42a4-9a32-cdaae7943d56 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:19.040344 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2293a-b82b-47ef-ad3a-e25615e403f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:19.041052 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2293a-b82b-47ef-ad3a-e25615e403f4 service placement] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:19.041336 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2293a-b82b-47ef-ad3a-e25615e403f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:19.041683 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2293a-b82b-47ef-ad3a-e25615e403f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:19.043515 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-aea2293a-b82b-47ef-ad3a-e25615e403f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:19.056264 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2293a-b82b-47ef-ad3a-e25615e403f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:19.058063 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2293a-b82b-47ef-ad3a-e25615e403f4 service placement] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:19.071126 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1459/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:19.085435 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0230f5-f30f-4d7c-80ce-f2a4c3677784 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:19.087040 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cc0230f5-f30f-4d7c-80ce-f2a4c3677784 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:19.169168 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0230f5-f30f-4d7c-80ce-f2a4c3677784 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:19.174613 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:19.175513 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:19.175796 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:19.176072 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] PATH_INFO: `/v3/users/4899d5724cec43fb94a817ca8382a317` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:19.177414 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4899d5724cec43fb94a817ca8382a317)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:19.179395 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:19.231592 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4899d5724cec43fb94a817ca8382a317'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.232245 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4899d5724cec43fb94a817ca8382a317'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.241594 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4899d5724cec43fb94a817ca8382a317'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.249112 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4899d5724cec43fb94a817ca8382a317'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.249752 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4899d5724cec43fb94a817ca8382a317'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.268584 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1450/2909] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:30:19 2022] DELETE /identity/v3/users/4899d5724cec43fb94a817ca8382a317 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:30:19.450413 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2293a-b82b-47ef-ad3a-e25615e403f4 service placement] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:19.461790 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2293a-b82b-47ef-ad3a-e25615e403f4 service placement] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:19.520997 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:19.521838 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:19.522120 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:19.522395 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] PATH_INFO: `/v3/projects/9075f764f9e043db91466161a007a2b4` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:19.523586 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9075f764f9e043db91466161a007a2b4)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:19.525532 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:19.574782 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9075f764f9e043db91466161a007a2b4', 'request_id': 'req-6ae3ba52-26a3-4406-a53d-33edf792555d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.580065 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9075f764f9e043db91466161a007a2b4', 'request_id': 'req-6ae3ba52-26a3-4406-a53d-33edf792555d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.588403 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9075f764f9e043db91466161a007a2b4', 'request_id': 'req-6ae3ba52-26a3-4406-a53d-33edf792555d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.600626 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] The token cache is being invalidate because project 9075f764f9e043db91466161a007a2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:30:19.600951 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.601666 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.603326 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1460/2910] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:30:19 2022] DELETE /identity/v3/projects/9075f764f9e043db91466161a007a2b4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:30:19.607537 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:19.609117 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:19.623846 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d6cf1-73d5-479b-a1ef-1e7621d96a3a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:19.691789 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:19.692689 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:19.692998 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:19.693274 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] PATH_INFO: `/v3/users/44d7a51d1b2a4ee7a673510d2bec32ca` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:19.694525 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d7a51d1b2a4ee7a673510d2bec32ca)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:19.696463 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:19.718265 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:19.746491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d7a51d1b2a4ee7a673510d2bec32ca'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.747441 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d7a51d1b2a4ee7a673510d2bec32ca'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.757029 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d7a51d1b2a4ee7a673510d2bec32ca'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.765254 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d7a51d1b2a4ee7a673510d2bec32ca'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.765914 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d7a51d1b2a4ee7a673510d2bec32ca'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:19.784413 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1451/2911] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jul 14 09:30:19 2022] DELETE /identity/v3/users/44d7a51d1b2a4ee7a673510d2bec32ca => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:30:19.972054 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:19.973744 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:19.991296 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3ba52-26a3-4406-a53d-33edf792555d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:20.055087 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed59d5d85ac94b5e83056380d59a4958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f90549ec6704d3aa11b6699bd90eefe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:20.055966 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:20.056251 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:20.056529 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] PATH_INFO: `/v3/projects/f8e3eb69c4ec46cea3f734330dcff72e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:20.058329 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e3eb69c4ec46cea3f734330dcff72e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:20.060469 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:20.083967 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:20.115771 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e3eb69c4ec46cea3f734330dcff72e', 'request_id': 'req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:20.121176 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e3eb69c4ec46cea3f734330dcff72e', 'request_id': 'req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:20.130204 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e3eb69c4ec46cea3f734330dcff72e', 'request_id': 'req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:20.143584 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] The token cache is being invalidate because project f8e3eb69c4ec46cea3f734330dcff72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:30:20.143869 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:20.144501 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-089adf8a-06f6-41ca-84bd-a0cf1d3e2bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:30:20.146440 dv-cinder-849626-4-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1461/2912] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jul 14 09:30:19 2022] DELETE /identity/v3/projects/f8e3eb69c4ec46cea3f734330dcff72e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:30:29.780879 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:30.140070 dv-cinder-849626-4-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:30.251575 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:32:30.253297 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:30.329904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e721d-9eba-4d67-8441-3459395f27ec admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:32:30.401128 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fadb2-5a2d-429f-a5db-d08fd7952693 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58986e97f4d849aba35149d3666db015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a3e3bae8f574e44a0782460fefc7162', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:32:30.402083 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fadb2-5a2d-429f-a5db-d08fd7952693 service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:30.402491 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fadb2-5a2d-429f-a5db-d08fd7952693 service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:30.402904 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fadb2-5a2d-429f-a5db-d08fd7952693 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:30.405953 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4e0fadb2-5a2d-429f-a5db-d08fd7952693 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:30.423653 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fadb2-5a2d-429f-a5db-d08fd7952693 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:32:30.425263 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fadb2-5a2d-429f-a5db-d08fd7952693 service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:32:30.435289 dv-cinder-849626-4-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1452/2913] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jul 14 09:32:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:32:40.431019 dv-cinder-849626-4-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=58 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}